Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data needs”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,405 records · Page 78

Distribution Function Instead of Steady-State Assumption in Time-Series Simulation

The quasi-steady-state assumption in time-series simulation is inadequate to model phenomena of interest to energy system integration such as inverter clipping, sell-back of excess electricity to a utility and utility hosting capacity, and battery throughput. Researchers are working on stochastic modeling, higher-resolution time series data, and machine learning approaches to address this need. This poster describes a distribution function that allows a maximum value, minimum value, and shape to the curve that can vary within each time-step based only on data inputs at the resolution of that time step (eg. Hourly). The distribution function is not used to synthesize high-resolution data, rather scalar integrals are used to calculate the quantities of interest within each time step. The form of the distribution function shows significant reduction in error when compared to 1 minute data and commercial software employing the distribution function (HOMER Pro version 14.3 and higher) shows a much improved estimate of inverter clipping in an example.

battery↗

Development of new baseline models for U.S. medium office buildings based on commercial buildings energy consumption survey data

Building energy estimation for the building sector under various scenarios are needed for building energy regulation and policy making. This often starts with representative baselines (either empirical baseline or modeled baseline). Commercial Buildings Energy Consumption Survey (CBECS) data is a widely used empirical baseline for U.S. commercial buildings, but none of the existing baseline model are developed to represent the CBECS data. This paper aims to develop new baseline models for the U.S. medium office buildings, which can produce modeled baselines consistent with the CBECS data. Here, we introduced the methodology to create baseline models and the criteria to evaluate the performance of baseline models. The methodology consists of three phases: (1) identification of model inputs, (2) model calibration, and (3) model validation with uncertainty analysis. The evaluation index is the coefficient of variation of the root-mean-square deviation (CV(RMSD)) of site energy use intensities (EUIs) between the modeled baseline and empirical baseline. Then 30 new baseline models for two vintages (pre- and post-1980) and 15 climate zones were created. The evaluation shows that the CV(RMSD) is lower than 0.05 for the modeled baselines produced by the new baseline models. As a comparison, the CV(RMSD) is higher than 0.1 for the existing modeled baselines generated by DOE Commercial Reference Building Models. Further analysis shows that the new baseline models are able to capture the uncertainties of the representative features of existing buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Multi-site evaluation of stratified and balanced sampling of soil organic carbon stocks in agricultural fields

Estimating soil organic carbon (SOC) stocks in agricultural fields is essential for environmental and agronomic research, management, and policy. Stratified sampling is a classic strategy for estimating mean soil properties, and has recently been codified in SOC monitoring protocols. However, for the specific task of estimating the SOC stock of an agricultural field, concrete guidance is needed for which covariates to stratify on and how much stratification can improve estimation efficiency. It is also unknown how stratified sampling of SOC stocks compares to modern alternatives, notably doubly balanced sampling. To address these gaps, we collected high-density (average of 7 samples ha -1 ) and deep (average of 75 cm) measurements of SOC stocks at eight commercial fields under maize-soybean production in two US Midwestern states. We combined these measurements with a Bayesian geostatistical model to evaluate stratified and balanced sampling strategies that use a set of readily-available geographic, topographic, spectroscopic, and soil survey data. We examined the number of samples needed to achieve a given level of SOC stock estimation accuracy. While stratified sampling using these variables enables an average sample size reduction of 17% (95% CI, 11% to 23%) compared to simple random sampling, doubly balanced sampling is consistently more efficient, reducing sample sizes by 32% (95% CI, 25% to 37%). The data most important to these efficiency gains are a remotely-sensed SOC index, SSURGO estimates of SOC stocks, and the topographic wetness index. We conclude that in order to meet the urgent challenge of climate change, SOC stocks in agricultural fields could be more efficiently estimated by taking advantage of this readily-available data, especially with doubly balanced sampling.

54 ENVIRONMENTAL SCIENCES↗

Spiner: Performance Portable Routines for Generic, Tabulated, Multi-Dimensional Data

We present Spiner, a new, performance-portable library for working with tabulated data. Spiner provides efficient routines for multi-dimensional interpolation and indexing on both CPUs and GPUs—as well as more exotic hardware—including interwoven interpolation and indexing access patterns, as needed for radiation transport. Importantly, Spiner defines a data format, based on HDF5, that couples the tabulated data to the information required to interpolate it, which Spiner can read and move to GPU.

97 MATHEMATICS AND COMPUTING↗

Dijet Acoplanarity in CUJET3 as a Probe of the Nonperturbative Color Structure of QCD Perfect Fluids

Using the CUJET3=DGLV+VISHNU jet-medium interaction framework, we show that dijet azimuthal acoplanarity in high energy A + A collisions is sensitive to possible non-perturbative enhancement of the jet transport coefficient, $\hat{q}$(T,E), in the QCD crossover temperature T ~ 150–300 MeV range. With jet-medium couplings constrained by global RHIC& LHC χ 2 fits to nuclear modification data on R AA (p T > 20) GeV, we compare predictions of the medium induced dijet transverse momentum squared, $Q_s^2~\langle \hat{q}L\rangle~ΔΦ^2E^2$, in two models of the temperature, T, and jet energy E dependence of the jet medium transport coefficient, $\hat{q}$(T,E)). In one model, wQGP, the chromo degrees of freedom (dof) are approximated by a perturbative dielectric gas of quark and gluons dof. In the second model, sQGMP, we consider a nonperturbative partially confined semi-Quark-Gluon-Monopole-Plasma with emergent color magnetic dof constrained by lattice QCD data. Unlike the slow variation of the scaled jet transport coefficient, $\hat{q}_{wQGP}/T^3$, the sQGMP model $\hat{q}_{sQGMP}/T^3$ features a sharp maximum in the QCD confinement crossover T range. We show that the dijet path averaged medium induced azimuthal acoplanarity, Δφ 2 , in sQGMP is robustly ~ 2 times larger than in perturbative wQGP. even though the radiative energy loss in both models is very similar as needed to fit the same R AA data. Future A+A dijet acoplanarity measurements constrained together with single jet R AA and ν n measurements therefore appears to be a promising strategy to search for possible signatures of critical opalescence like phenomena in the QCD confinement temperature range.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Deep learning-driven super-resolution in Raman hyperspectral imaging: Efficient high-resolution reconstruction from low-resolution data

Deep learning (DL) has become an indispensable tool in hyperspectral data analysis, automatically extracting valuable features from complex, high-dimensional datasets. Super-resolution reconstruction, an essential aspect of hyperspectral data, involves enhancing spatial resolution, particularly relevant to low-resolution hyperspectral data. Yet, the pursuit of super-resolution in hyperspectral analysis is fraught with challenges, including acquiring ground truth high-resolution data for training, generalization, and scalability. The pressing issue of extended spectral acquisition times, notably for high-resolution scans, is a significant roadblock in hyperspectral imaging. Super-resolution methods offer a promising solution by providing higher spatial resolution data to expedite data collection and yield more efficient outcomes. This paper delves into a practical application of these concepts using Raman imaging, where spectral acquisition times can be prohibitively long. In this context, DL-based super-resolution models demonstrate their efficacy by predicting and reconstructing high-resolution Raman data from low-resolution input, eliminating the need for resource-intensive high-resolution scans. While previous work often relied on substantial high-resolution datasets, this study showcases the ability to achieve similar outcomes even with limited data, presenting a more practical and cost-effective approach. In conclusion, the results offer a glimpse into the transformative potential of this technology to streamline hyperspectral imaging applications by saving valuable time and resources through the successful generation of high-resolution data from low-resolution inputs.

42 ENGINEERING↗

Spatial Study 2021: Sample-Based Surface Water Chemistry and Organic Matter Characterization across Watersheds in the Yakima River Basin, Washington, USA (v3)

This dataset supports a broader study examining the drivers of spatial variability in sediment respiration rates in the Yakima River Basin. The dataset provides geochemistry and organic matter characterization data generated from samples collected during the same two-week period at 47 sites within multiple rivers throughout the Yakima River Basin in Washington, USA. Related sensor data are published at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1892054. This data package was originally published September 2022. It was updated May 2023 (modified files) and November 2024 (new and modified files). See the change history section in the readme for more details. This dataset is comprised of one main data folder containing (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) dissolved inorganic carbon (DIC), dissolved organic carbon (DOC; reported as non-purgeable organic carbon; NPOC), total nitrogen (TN), total suspended solids (TSS), ions, and benzene polycarboxylic acid (BPCA) concentration and stable isotope data; (5) averaged values from water chemistry data; (6) surface water sampling protocol; (7) sensor protocol (8) readme; (9) methods codes; (10) international generic-sample number (IGSN) mapping file; and (11) folder of high resolution characterization of organic matter via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory). This folder contains two subfolders, one containing the .xml data files and the other containing instructions for using Formultitude (https://github.com/PNNL-Comp-Mass-Spec/Formultitude) and an R script to process the data based on the user's specific needs. All files are .csv, .pdf, .R, .ref, or .xml. We thank the United States Forest Service, Washington Department of Natural Resources, Washington Department of Fish and Wildlife, Washington State Parks, Confederated Tribes and Bands of the Yakama Nation, and Cowiche Canyon Conservancy for access to field locations where these samples were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate sample collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

PRO-X Research Reactor Database Status

The PRO-X Research Reactor Database is a functioning tool that can be used to quickly view attributes of past, current, and future research reactors. It contains all data found in the IAEA Research Reactor Database and entries generated from the M3 fuel conversion program. Additionally, it can be downloaded to any computer with the ability to run Microsoft ACCESS. Several research reactor attributes visible to the user have a limited amount of information, much of which is available and vetted for entry into the database. However, the necessary resources have not been allocated to add this information to the data tables. A change management system has also been developed to track changes to the database. This would need to be incorporated into the database program prior to data table modification in order to ensure proper management of the changes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Infrared-enhanced Photometric Redshifts for the Dark Energy Survey Y6 Gold catalogue

The Dark Energy Survey (DES) provides optical data across 5000 square degrees of the southern sky, enabling a broad range of extragalactic and cosmological studies. Combining DES data with infrared surveys offers the opportunity to improve its photometric redshift (photo-z) estimates. We aim to investigate improvements in photometric redshift estimation achieved by combining DES optical data with infrared measurements from the VISTA Hemisphere Survey (VHS) and the Wide-field Infrared Survey Explorer (WISE), and release an updated version of the catalogue. We performed a positional sky cross-match between the DES Y6 Gold catalogue matched to a spectroscopic dataset, the 2013 AllWISE Data Release, and VHS Data Release 5, in order to test these improvements using the Directional Neighbourhood Fitting (DNF) algorithm (Y6 Gold catalogue reference estimator). We additionally matched it to the unWISE catalogue to verify the performance against this deeper dataset. Adding infrared data reduces all the metrics (scatter, bias and outlier fraction) in photo-z estimates, particularly at higher redshifts in comparison with only using optical data from DES. The obtained results are globally better for the DES+WISE sample, with improvements that are statistically significant. On the other hand, the addition of the VHS bands to available depth is only marginal. The combined use of DES and WISE W1 and W2 data improves the photometric redshift metrics analysed here. The addition of VHS data at the DES and VHS depths explored here does not provide any further improvement at z less than 1.5, indicating that, under these constraints, WISE data may already capture the key infrared features and depth needed for accurate photo-z estimation. In addition, low signal-to-noise (less than 10) infrared data does not contribute to any improvement beyond the DES optical dataset.

Puebla, M. M. [Madrid U.; Madrid, CIEMAT]↗

GPU-enabled extreme-scale turbulence simulations: Fourier pseudo-spectral algorithms at the exascale using OpenMP offloading

Fourier pseudo-spectral methods for nonlinear partial differential equations are of wide interest in many areas of advanced computational science, including direct numerical simulation of three-dimensional (3-D) turbulence governed by the Navier-Stokes equations in fluid dynamics. This paper presents a new capability for simulating turbulence at a new record resolution up to 35 trillion grid points, on the world's first exascale computer, Frontier, comprising AMD MI250x GPUs with HPE's Slingshot interconnect and operated by the US Department of Energy's Oak Ridge Leadership Computing Facility (OLCF). Key programming strategies designed to take maximum advantage of the machine architecture involve performing almost all computations on the GPU which has the same memory capacity as the CPU, performing all-to-all communication among sets of parallel processes directly on the GPU, and targeting GPUs efficiently using OpenMP offloading for intensive number-crunching including 1-D Fast Fourier Transforms (FFT) performed using AMD ROCm library calls. With 99% of computing power on Frontier being on the GPU, leaving the CPU idle leads to a net performance gain via avoiding the overhead of data movement between host and device except when needed for some I/O purposes. Memory footprint including the size of communication buffers for MPI_ALLTOALL is managed carefully to maximize the largest problem size possible for a given node count. Detailed performance data including separate contributions from different categories of operations to the elapsed wall time per step are reported for five grid resolutions, from 2048 3 on a single node to 32768 3 on 4096 or 8192 nodes out of 9408 on the system. Both 1D and 2D domain decompositions which divide a 3D periodic domain into slabs and pencils respectively are implemented. The present code suite (labeled by the acronym GESTS, GPUs for Extreme Scale Turbulence Simulations) achieves a figure of merit (in grid points per second) exceeding goals set in the Center for Accelerated Application Readiness (CAAR) program for Frontier. The performance attained is highly favorable in both weak scaling and strong scaling, with notable departures only for 2048 3 where communication is entirely intra-node, and for 32768 3 , where a challenge due to small message sizes does arise. Communication performance is addressed further using a lightweight test code that performs all-to-all communication in a manner matching the full turbulence simulation code. Performance at large problem sizes is affected by both small message size due to high node counts as well as dragonfly network topology features on the machine, but is consistent with official expectations of sustained performance on Frontier. Overall, although not perfect, the scalability achieved at the extreme problem size of 32768 3 (and up to 8192 nodes — which corresponds to hardware rated at just under 1 exaflop/sec of theoretical peak computational performance) is arguably better than the scalability observed using prior state-of-the-art algorithms on Frontier's predecessor machine (Summit) at OLCF. New science results for the study of intermittency in turbulence enabled by this code and its extensions are to be reported separately in the near future.

3D fast Fourier transform↗

Critical Infrastructure Classification via CNN-based Modeling and Image Analysis

With recent advances in the fields of satellite imagery and machine learning we now have the ability to develop explainable deep learning models that enhance critical infrastructure analysis. Funded through Idaho National Laboratory’s (INL) Laboratory Directed Research and Development (LDRD) office we are in the process of developing a deep learning model capable of identifying critical infrastructure facilities and embedded features within those facilities. Utilizing current limit of practice techniques in the machine learning areas of explainability and transfer learning our model, once complete, will have the capacity to be used on multiple different imagery data sets and produce results that not only classify critical infrastructure facilities, but also explain why a critical infrastructure facility was classified as a certain type of facility. These advancements eliminate the ‘black box’ approach deep learning models have had in the past, where a user will have to trust the conclusion of a model without understanding what reasoning when into the model’s classification process. They also expand a model’s usefulness, traditionally a deep learning model will have to use the same data set it was originally trained on. Given the long training times of deep learning models this is impractical in a number of scenarios. By utilizing transfer learning advancements, we are eliminating the need to train our model on the same data set it is then run on to classify critical infrastructure facilities. We are also enabling the analysis and classification of data sets that are potentially too small to be divided into a training and testing data set. Once completed this model can provide a foundation to enhanced critical infrastructure analysis, dependency analysis, and potential disaster relief efforts.

97 MATHEMATICS AND COMPUTING↗

The calculation of light element impurity (α, n) yield curves in a PuO 2 matrix and associated specific yield coefficients: Influence of the reaction cross sections

Most of the Pu separated from irradiated commercial nuclear fuel is stored as PuO 2 . The primary quantitative nondestructive measurement technique used to verify the amount of Pu in storage containers is passive neutron correlation counting. An important physical property of the oxide material is the ratio, α, of the rate of (α, n) neutrons produced inside the item to the rate of neutrons produced by spontaneous fission. This ratio influences the precision of the correlated counting method and affects the interpretation of the data because of how it changes both the primary total neutron production rate and the rate of induced fission events taking place inside the item. In addition to the main O(α, n) contribution, additional contributions come from α-particle interactions with light element impurities that are inevitably present. In this work, we calculate specific (α, n) yield coefficients, expressed in units of neutrons per second per gram of α-emitting nuclide per part per million by mass of the specified impurity element distributed in a pure PuO 2 matrix, for some key α-emitting actinides commonly present in reprocessed Pu ( 238–242 Pu+ 241 Am). These coefficients are directly applicable to nuclear safeguards verification work in which the α ratio is often calculated from the Pu-isotopic composition and chemical information obtained by other means. Further, they also provide a convenient up-to-date reference set against which values generated by other methods can be compared. Results are presented for impurities with atomic number from 3 to 17 inclusive, plus K and Fe. In most cases, these coefficients are not expected to change by more than 5%–10% at any time in the future. However, as new data become available, changes as large as 20% may be needed for some targets (e.g., F). The present yield calculations are limited by the general shortage of quality experimental total (α, n) reaction cross section data, which, together with unexplained variation between determinations, means that an objective and coherent evaluation is not possible. The situation is even less satisfactory for the partial differential cross section needed to calculate neutron spectra.

(𝛼, n) reactions↗

Data Assimilation for Robust UQ Within Agent-Based Simulation on HPC Systems

Agent-based simulation provides a powerful tool for in silico system modeling. However, these simulations do not provide built-in methods for uncertainty quantification (UQ). Within these types of models a typical approach to UQ is to run multiple realizations of the model then compute aggregate statistics. This approach is limited due to the compute time required for a solution. When faced with an emerging biothreat, public health decisions need to be made quickly and solutions for integrating near real-time data with analytic tools are needed. We propose an integrated Bayesian UQ framework for agent-based models based on sequential Monte Carlo sampling. Given streaming or static data about the evolution of an emerging pathogen this Bayesian framework provides a distribution over the parameters governing the spread of a disease through a population. These estimates of the spread of a disease may be provided to public health agencies seeking to abate the spread. By coupling agent-based simulations with Bayesian modeling in a data assimilation, our proposed framework provides a powerful tool for modeling dynamical systems in silico. We propose a method which reduces model error and provides a range of realistic possible outcomes. Moreover, our method addresses two primary limitations of ABMs: the lack of UQ and an inability to assimilate data. Our proposed framework combines the flexibility of an agent-based model with UQ provided by the Bayesian paradigm in a workflow which scales well to HPC systems. We provide algorithmic details and results on a simulated outbreak with both static and streaming data.

Spannaus, Adam [ORNL] (ORCID:0000000225213657)↗

Performance Evaluation of Comparative Vacuum Monitoring and Piezoelectric Sensors for Structural Health Monitoring of Rotorcraft Components

The costs associated with the increasing maintenance and surveillance needs of aging structures are rising at an unexpected rate. Multi-site fatigue damage, hidden cracks in hard-to-reach locations, disbonded joints, erosion, impact, and corrosion are among the major flaws encountered in today’s extensive fleet of aging aircraft and space vehicles. Aircraft maintenance and repairs represent about a quarter of a commercial fleet’s operating costs. The application of Structural Health Monitoring (SHM) systems using distributed sensor networks can reduce these costs by facilitating rapid and global assessments of structural integrity. The use of in-situ sensors for real-time health monitoring can overcome inspection impediments stemming from accessibility limitations, complex geometries, and the location and depth of hidden damage. Reliable, structural health monitoring systems can automatically process data, assess structural condition, and signal the need for human intervention. The ease of monitoring an entire on-board network of distributed sensors means that structural health assessments can occur more often, allowing operators to be even more vigilant with respect to flaw onset. SHM systems also allow for condition-based maintenance practices to be substituted for the current time-based or cycle-based maintenance approach thus optimizing maintenance labor. The Federal Aviation Administration has conducted a series of SHM validation and certification programs intended to comprehensively support the evolution and adoption of SHM practices into routine aircraft maintenance practices. This report presents one of those programs involving a Sandia Labs-aviation industry effort to move SHM into routine use for aircraft maintenance. The Airworthiness Assurance NDI Validation Center (AANC) at Sandia Labs, in conjunction with Sikorsky, Structural Monitoring Systems Ltd., Anodyne Electronics Manufacturing Corp., Acellent Technologies Inc., and the Federal Aviation Administration (FAA) carried out a trial validation and certification program to evaluate Comparative Vacuum Monitoring (CVM) and Piezoelectric Transducers (PZT) as a structural health monitoring solution to specific rotorcraft applications. Validation tasks were designed to address the SHM equipment, the health monitoring task, the resolution required, the sensor interrogation procedures, the conditions under which the monitoring will occur, the potential inspector population, adoption of CVM and PZT systems into rotorcraft maintenance programs and the document revisions necessary to allow for their routine use as an alternate means of performing periodic structural inspections. This program addressed formal SHM technology validation and certification issues so that the full spectrum of concerns, including design, deployment, performance and certification were appropriately considered. Sandia Labs designed, implemented, and analyzed the results from a focused and statistically relevant experimental effort to quantify the reliability of a CVM system applied to Sikorsky S-92 fuselage frame application and a PZT system applied to an S-92 main gearbox mount beam application. The applications included both local and global damage detection assessments. All factors that affect SHM sensitivity were included in this program: flaw size, shape, orientation and location relative to the sensors, as well as operational and environmental variables. Statistical methods were applied to performance data to derive Probability of Detection (POD) values for SHM sensors in a manner that agrees with current nondestructive inspection (NDI) validation requirements and is acceptable to both the aviation industry and regulatory bodies. The validation work completed in this program demonstrated the ability of both CVM and PZT SHM systems to detect cracks in rotorcraft components. It proved the ability to use final system response parameters to provide a Green Light/Red Light (“GO” – “NO GO”) decision on the presence of damage. In additional to quantifying the performance of each SHM system for the trial applications on the S-92 platform, this study also identified specific methods that can be used to optimize damage detection, guidance on deployment scenarios that can affect performance and considerations that must be made to properly apply CVM and PZT sensors. These results support the main goal of safely integrating SHM sensors into rotorcraft maintenance programs. Additional benefits from deploying rotorcraft Health and Usage Monitoring Systems (HUMS) may be realized when structural assessment data, collected by an SHM system, is also used to detect structural damage to compliment the operational environment monitoring. The use of in-situ sensors for health monitoring of rotorcraft structures can be a viable option for both flaw detection and maintenance planning activities. This formal SHM validation will allow aircraft manufacturers and airlines to confidently make informed decisions about the proper utilization of CVM and PZT technology. It will also streamline future regulatory actions and formal certification measures needed to assure the safe application of SHM solutions.

42 ENGINEERING↗

4th Big Data for Nuclear Power Plants Workshop 2023

The Ohio State University and Idaho National Laboratory organized the 4 th Big Data for Nuclear Power Plants Workshop in November, 2023 in Columbus, Ohio. Workshop topics were chosen to understand the challenges and gaps that need to be addressed to maximize the impact of data on the nuclear industry, as well as the associated applications and risks. Discussions were focused around six specific application areas: Operation and Maintenance; Machine Learning in Nuclear Materials and Advanced Manufacturing; Cybersecurity; High-Performance Computing and Massive Computation; Big Data and Digital Twins; and Nuclear Non-Proliferation. The opportunities, challenges, and risks identified in the six focus areas explored in this workshop are diverse, but some common themes emerge, such as the importance of data integrity, quality, coverage, privacy, and traceability. Big data and AI/ML tools can be leveraged to reduce costs, optimize human tasking, and reduce human error across various application areas. In order for the nuclear industry to benefit from big data and advanced analytic capabilities, it is essential to address challenges and risks, such as data privacy, model reliability, and computational resource availability. Learning from other industries that have successfully implemented big data and AI/ML technologies, like the aerospace industry, can help the nuclear industry successfully integrate these technologies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

LCLS Big Data Handling – How I Learned to Stop Worrying and Love the Data Deluge

Advanced data and computing systems are vital to Linac Coherent Light Source (LCLS) operations, data interpretation and overall scientific productivity. The transition to MHz-era operation marks a fundamental change in scale that requires new infrastructure and architectures to link LCLS to the required scale of computing needed for scientific interpretation. The LCLS-II Data System meets big data challenges by implementing configurable data reduction that can adapt to multiple science areas, real-time analysis frameworks to provide visualization and fast feedback, and the ability to transfer data to local and remote computational facilities for near real time analysis at the appropriate scale. Feature extracted information generated in the data analysis pipeline - at the edge, local compute, or remote High-Performance Computing (HPC) resources - can be used to steer experiments and inform user decisions during beam time. Artificial Intelligence and Machine Learning (AI/ML) techniques present new opportunities to rapidly analyse large datasets and direct experiments, but create new challenges in scaling, adaptability, complexity, and trustworthiness. We describe how the LCLS-II Data System architecture addresses its data-driven challenges in the areas of data acquisition, data processing, data management, and workflow orchestration to decrease the overall time-to-science and provide a vision for future developments.

artificial intelligence↗

HDBind: encoding of molecular structure with hyperdimensional binary representations

Traditional methods for identifying “hit” molecules from a large collection of potential drug-like candidates rely on biophysical theory to compute approximations to the Gibbs free energy of the binding interaction between the drug and its protein target. These approaches have a significant limitation in that they require exceptional computing capabilities for even relatively small collections of molecules. Increasingly large and complex state-of-the-art deep learning approaches have gained popularity with the promise to improve the productivity of drug design, notorious for its numerous failures. However, as deep learning models increase in their size and complexity, their acceleration at the hardware level becomes more challenging. Hyperdimensional Computing (HDC) has recently gained attention in the computer hardware community due to its algorithmic simplicity relative to deep learning approaches. The HDC learning paradigm, which represents data with high-dimension binary vectors, allows the use of low-precision binary vector arithmetic to create models of the data that can be learned without the need for the gradient-based optimization required in many conventional machine learning and deep learning methods. This algorithmic simplicity allows for acceleration in hardware that has been previously demonstrated in a range of application areas (computer vision, bioinformatics, mass spectrometery, remote sensing, edge devices, etc.). To the best of our knowledge, our work is the first to consider HDC for the task of fast and efficient screening of modern drug-like compound libraries. We also propose the first HDC graph-based encoding methods for molecular data, demonstrating consistent and substantial improvement over previous work. We compare our approaches to alternative approaches on the well-studied MoleculeNet dataset and the recently proposed LIT-PCBA dataset derived from high quality PubChem assays. We demonstrate our methods on multiple target hardware platforms, including Graphics Processing Units (GPUs) and Field Programmable Gate Arrays (FPGAs), showing at least an order of magnitude improvement in energy efficiency versus even our smallest neural network baseline model with a single hidden layer. Our work thus motivates further investigation into molecular representation learning to develop ultra-efficient pre-screening tools. We make our code publicly available at https://github.com/LLNL/hdbind.

59 BASIC BIOLOGICAL SCIENCES↗

National Energy Water Treatment & Speciation (NEWTS): A Water & Critical Mineral Database and Dashboard

The scarcity of water resources, the need for beneficial water reuse, and the challenges of wastewater treatment are becoming increasingly pressing in economic, social, and environmental domains. Addressing these concerns requires effective treatment strategies to manage wastewater streams and tackle environmental and economic issues. Furthermore, the recovery of critical minerals from the waste streams associated with energy production holds the promise of offsetting treatment costs and securing local sources of valuable minerals. However, relevant data on these waste streams are dispersed and challenging to locate. The process of ingesting such data into modeling software often involves multiple steps, requiring data restructuring to meet software-input requirements. The non-standardized reporting of water data makes data aggregation and reformatting a time-consuming process. Additionally, essential attributes necessary for modeling water treatment and mineral scale formation are frequently missing. Moreover, data gaps vary depending on the region of interest. Consequently, there is a pressing need for high-quality energy-water composition data that can be easily imported into water chemistry modeling software. To address this need, the National Energy Technology Laboratory has created the National Energy Water Treatment and Speciation (NEWTS) Database and Dashboard—a free online tool catering to community leaders and water researchers. NEWTS facilitates a comprehensive understanding of the composition of energy-related wastewater streams in the United States. The datasets provide detailed concentrations and speciation of major and minor aqueous compounds in energy-related wastewater streams, including power plant leachate, acid mine drainage, brackish water, and oil and gas produced water across the United States. Many of the aqueous species are critical minerals (Li, REEs) in high demand to modernize the world’s energy infrastructure. Many of the datasets also contain volumetric flow-rates needed to model the treatment and reuse scenarios in advanced aqueous chemistry software programs. The NEWTS Database and Dashboard offer public access to hitherto challenging-to-access datasets, presented in a standardized format that is tailored for easy input into aqueous chemistry modeling software. By performing the work needed to transform dispersed, disparate data sources into unified, model-ready datasets, NEWTS serves as an essential resource in advancing water treatment research and sustainable water resource management.

produced water management↗