Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

A Survey on the Expanding Scope and Interdisciplinary Opportunities for Processing-in-Memory Techniques

Processing-in-Memory (PIM) is emerging as a practical path to overcome the limitations of traditional von Neumann architectures. At its core, PIM systems implement computing primitives such as logic operations and multiply-accumulate acceleration through compute-in-memory, near-memory processing, or hybrid designs. The role of memory cells varies widely across technologies, acting as inputs, outputs, or analog accumulators through bit-lines and sense amplifiers. This diversity creates trade-offs in precision, bandwidth, latency, and programmability, making it difficult to build a unified understanding on the progress of the field. In this survey, we organize recent advances of PIM into three areas. First, we discuss the progress on the architectural optimizations of PIM and its integration with both DRAM and emerging non-volatile memories. Second, we examine how PIM is being used to accelerate key computing domains, including generative AI workloads and high-performance kernels, along with new approaches. Third, we highlight the growing adoption of PIM in computational sciences, where it is being applied to solve interdisciplinary problems such as genome analysis, mRNA quantification, mass spectrometry, quantum circuit simulation, wave modeling, and secure computation. Finally, we synthesize the major challenges that continue to slow PIM adoption, including manufacturing constraints, power delivery, thermal reliability, data consistency, runtime and memory-management coordination, and the difficulty of building portable software abstractions without sacrificing commercial viability. This work provides an updated, structured perspective on PIM’s potential across computing and computational sciences and the barriers that must be solved for it to reach its full impact.

Asifuzzaman, Kazi [Oak Ridge National Laboratory (↗
DOE OSTI2020

Remote Radiation Sensing Using Aerial and Ground Platforms

Remote sensing of ionizing radiation has a significant role in waste management, nuclear material management and nonproliferation, and radiation safety. Robotic platforms can surpass the number of tasks that are achieved by humans. With this technique, the operator's radiation exposure can be decreased. Remote sensing allows for the evaluation and monitoring of radiological contamination. Gamma-ray and neutron sensors were integrated onto the robotic platforms. This approach allows for the radiation sensor data to be dynamically tracked and mapped thus enabling further analysis of the radiation flux in temporal and spatial domains. The goal is to complete scheduled tasks while the robot is being irradiated. To achieve this, electronic components must be shielded and radiation hardened. CZT Detector: Cadmium Zinc Telluride (CZT) detector technology has been a promising solution for gamma-ray and x-ray measurements. Detector data is transferred to the Odroid minicomputer that controls and powers the module via the USB. Robot Operating System (ROS) was utilized for data acquisition and data fusion. The Mariscotti method was employed for the spectrum analysis. A function was programmed in ROS for the automatic identification of photopeaks. CLYC Detector: A Cs{sub 2}LiYCl{sub 6}:Ce{sup 3+} (CLYC) detector was used for simultaneous medium-resolution gamma-ray measurements and neutron counting. A 2.54 cm diameter photomultiplier tube (PMT) was equipped with a high voltage supply and a miniature digitizer. Gamma-ray excitation: fast core-to-valence luminescence (CVL) with 1 ns decay constant, and prompt Ce{sup 3+} emission with 50 ns decay constant. Neutron excitation: slow cerium self-trapped excitation (Ce{sup 3+} STE), 1000 ns decay constant. Radiation Source Localization: Maximum Likelihood Estimation (MLE) and gradient-based methods were used to locate the position of a radiation source based on measured radiation intensities. Multi-Particle Transport Code FLUKA: Estimation of radiation damage of the electronic components is important in order to optimize the robot's operational time while it is irradiated. Displacement per atom (DPA) represents the radiation damage in materials exposed to the ionizing radiation. Various shielding layers of different thickness t were analyzed (< 5% statistical error). The model of the controller of the UAS was designed in FLUKA. Conclusion: CZT and CLYC detectors were integrated onto the robotic platforms. Radiation source localization and contour mapping using robotic platforms were studied. Functions for data analysis and fusion were developed in ROS. FLUKA code was utilized to analyze DPA values. Layers of low-density and high-density materials were used to shield the UAS electronics.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Nuclear Physics Network Requirements Review (Final Report)

The Energy Sciences Network (ESnet) is the high-performance network user facility for the US Department of Energy (DOE) Office of Science (SC) and delivers highly reliable data transport capabilities optimized for the requirements of data-intensive science. In essence, ESnet is the circulatory system that enables the DOE science mission by connecting all its laboratories and facilities in the US and abroad. ESnet is funded and stewarded by the Advanced Scientific Computing Research (ASCR) program and managed and operated by the Scientific Networking Division at Lawrence Berkeley National Laboratory (LBNL). ESnet is widely regarded as a global leader in the research and education networking community. ESnet interconnects DOE national laboratories, user facilities, and major experiments so that scientists can use remote instruments and computing resources as well as share data with collaborators, transfer large datasets, and access distributed data repositories. ESnet is specifically built to provide Between July 2023 and October 2023, ESnet and the Nuclear Physics program (NP) of the DOE SC organized an ESnet requirements review of NP-supported activities. Preparation for these events included identification of key stakeholders: program and facility management, research groups, and technology providers. Each stakeholder group was asked to prepare formal case study documents about its relationship to the NP program to build a complete understanding of the current, near-term, and long-term status, expectations, and processes that will support the science going forward.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Predicting plant attractiveness to coccinellids with plant trait profiling, citizen science, and common garden surveys

Lady beetles are key predators in agricultural systems and their impact can be enhanced by plant resources. Facilitation of lady beetles is a potentially effective pest management strategy but a lack of data on which plant species attract and nurture them limits implementation. Here we investigate which plant species might optimize lady beetle impact by developing a profile of plant characteristics most likely to attract lady beetles and testing if the subset of “potentially preferred” plant families exhibiting those characteristics are significantly more attractive to lady beetles than other families. This testing encompassed a combination of observations submitted to a citizen science program, the Lost Ladybug Project, and two repeated site surveys. Traits reported to be most attractive to lady beetles included the presence of trichomes that provide protection from predation, nutritional resources such as nectar or prey, and visual or chemical cues associated with those traits. Significantly more lady beetles were observed on the three plant families which most often exhibit these traits, Apiaceae, Asteraceae, and Rosaceae, than on other families. Furthermore, strategies for incorporating plants from these families into production systems to attract lady beetles and limit pest damage are discussed.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Mechanistic Approach to Analyzing and Improving Unconventional Hydrocarbon Production [Slides]

DOE research is developing the physical basis and tools needed to manage pressure effectively to increase recovery efficiency. By coupling fast, accurate physics with machine learning, DOE is producing science-based platforms any operator can use. DOE’s research portfolio is targeting hydrocarbon transport at multiple scales, with the goal of increasing recovery efficiency. DOE’s research has led to new, fast & accurate platforms for predicting gas production from fractured shales. Using data from the MSEEL-I site to calibrate our physics-based model, we have early results on pressure management. We have shown that both mechanical and chemical processes in the matrix can negatively impact production.

08 HYDROGEN↗
DOE OSTI2021

Efficient loading of reduced data ensembles produced at ORNL SNS/HFIR neutron time-of-flight facilities

We present algorithmic improvements to the loading operations of certain reduced data ensembles produced from neutron scattering experiments at Oak Ridge National Laboratory (ORNL) facilities. Ensembles from multiple measurements are required to cover a wide range of the phase space of a sample material of interest. They are stored using the standard NeXus schema on individual HDF5 files. This makes it a scalability challenge, as the number of experiments stored increases in a single ensemble file. The present work follows up on our previous efforts on data management algorithms, to address identified input output (I/O) bottlenecks in Mantid, an open-source data analysis framework used across several neutron science facilities around the world. We reuse an in-memory binary-tree metadata index that resembles data access patterns, to provide a scalable search and extraction mechanism. In addition, several memory operations are refactored and optimized for the current common use cases, ranging most frequently from 10 to 180, and up to 360 separate measurement configurations. Results from this work show consistent speed ups in wall-clock time on the Mantid LoadMD routine, ranging from 19% to 23% on average, on ORNL production computing systems. The latter depends on the complexity of the targeted instrument-specific data and the system I/O and compute variability for the shared computational resources available to users of ORNL’s Spallation Neutron Source (SNS) and the High Flux Isotope Reactor (HFIR) instruments. Nevertheless, we continue to highlight the need for more research to address reduction challenges as experimental data volumes, user time and processing costs increase.

Godoy, William↗
DOE OSTI2020

Mesoscale Science Data Analytics

This is software that will be used to do data analytics in experimental workflows for x-ray mesoscale science. This tool set will provide a mechanism for supporting experiments in many ways, from collecting calibration information and raw data, to managing and viewing data to extracting crystallographic and physical parameters. It will eventually include development of a fully automated workflow that will include statistical information and prediction capabilities to support the scientists in decision-making and replanning their experiments when necessary.

Sweeney, Christine↗
DOE OSTI2024

Foldy: An open-source web application for interactive protein structure analysis

Foldy is a cloud-based application that allows non-computational biologists to easily utilize advanced AI-based structural biology tools, including AlphaFold and DiffDock. With many deployment options, it can be employed by individuals, labs, universities, and companies in the cloud without requiring hardware resources, but it can also be configured to utilize locally available computers. Foldy enables scientists to predict the structure of proteins and complexes up to 6000 amino acids with AlphaFold, visualize Pfam annotations, and dock ligands with AutoDock Vina and DiffDock. In our manuscript, we detail Foldy’s interface design, deployment strategies, and optimization for various user scenarios. We demonstrate its application through case studies including rational enzyme design and analyzing proteins with domains of unknown function. Furthermore, we compare Foldy’s interface and management capabilities with other open and closed source tools in the field, illustrating its practicality in managing complex data and computation tasks. Our manuscript underlines the benefits of Foldy as a day-to-day tool for life science researchers, and shows how Foldy can make modern tools more accessible and efficient.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

US Department of Energy, Office of Science, High-Performance Computing Facility 2024 Operational Assessment Oak Ridge Leadership Computing Facility

The Oak Ridge Leadership Computing Facility (OLCF) was established to accelerate scientific discovery by providing world-leading computational performance and advanced data infrastructure to the US Department of Energy (DOE) computing community. As a DOE Office of Science user facility, the OLCF has managed the successful deployment and operation of a succession of leadership-class resources dedicated to open science. In addition to these resources, the OLCF staff continually strive to develop innovative processes and technologies, improve security, and empower users through effective allocation management and comprehensive user support and training. These efforts support the advancement of science by the OLCF users and benefit high-performance computing (HPC) facilities around the world.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Integrating the PanDA Workload Management System with the Vera C. Rubin Observatory

The Vera C. Rubin Observatory will produce an unprecedented astronomical data set for studies of the deep and dynamic universe. Its Legacy Survey of Space and Time (LSST) will image the entire southern sky every three to four days and produce tens of petabytes of raw image data and associated calibration data over the course of the experiment’s run. More than 20 terabytes of data must be stored every night, and annual campaigns to reprocess the entire dataset since the beginning of the survey will be conducted over ten years. The Production and Distributed Analysis (PanDA) system was evaluated by the Rubin Observatory Data Management team and selected to serve the Observatory’s needs due to its demonstrated scalability and flexibility over the years, for its Directed Acyclic Graph (DAG) support, its support for multi-site processing, and its highly scalable complex workflows via the intelligent Data Delivery Service (iDDS). PanDA is also being evaluated for prompt processing where data must be processed within 60 seconds after image capture. This paper will briefly describe the Rubin Data Management system and its Data Facilities (DFs). Finally, it will describe in depth the work performed in order to integrate the PanDA system with the Rubin Observatory to be able to run the Rubin Science Pipelines using PanDA.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Ambient Mass Spectrometry Rapid Analysis Methods for Trace Inorganics

The ability to rapidly detect and characterize the chemistry of trace quantities of inorganic species has multiple potential applications, including nuclear safeguards, nuclear forensics, and environmental monitoring. Some mass spectrometric methods currently exist, but they are costly and time-intensive, often destroying chemical information in the process of ionization. Ambient mass spectrometry is a relatively new analytical method in which samples are introduced to the mass spectrometer from atmospheric pressure, rather than from high vacuum. Ambient MS can operate with gentler ionization methods such as electrospray ionization (ESI) and paper-spray ionization (PSI), reducing fragmentation and preserving the chemical information of the analyte. This may be useful for determining the intended purpose of material in a sample. Strontium, part of nuclear fallout, is analyzed here to test these new analytical methods for viability. Electrospray ionization mass spectrometry functions by spraying the sample as a solution through a needle charged to a few kV. A nebulizing gas flows out along with the sample to create the spray before droplets enter a drying chamber with heated drying gas to remove the solvent molecules. From there bare analyte ions enter the mass spectrometer. This method has the advantage of relatively fast sample preparation and stable ionization. More stable ionization produces higher-quality data. Paper-spray ionization mass spectrometry operates by applying sample to a paper triangle. The paper triangle is then electrified in a metal clamp to a few kV before spray solvent is applied. The spray solvent transports analyte in the sample to the tip, where it is ionized and enters the mass spectrometer. One advantage of this method is reduced sample preparation - an analyst can even swipe a surface and cut a triangle directly from the swipe. The data analysis serves to rapidly process tens of samples all at once. The mass spectrometer outputs a file containing a few hundred spectra for each sample. The pipeline processes each one to identify peaks of interest. A full palette of data analysis metrics are generated, including plots of the raw data and plots of calculated values such as isotopic ratios. The pipeline filters the raw data to remove noise and background peaks, as well as peaks representing detector saturation. A heat map is generated to show the overall spectrum in mass-time- intensity space. Post-processing, we obtained the desired calibration curves, demonstrating that both ESI-MS and PSI-MS are viable methods for quantifying trace amounts of inorganics while retaining their chemical speciation information. ESI-MS demonstrated a linear response region of 100 ppb to 20 ppm, with a limit-of-detection of around 100 ppb. At top left is an example spectrum with the {sup 88}SrNO{sub 3} peak identified to show the retention of chemical speciation. PSI-MS showed a linear response region of around 1 ppb to 1 ppm, with a limit-of-detection of near 1 ppb. PSI-MS produced more erratic results than ESI-MS, likely due to the variability in ionization resulting from manual positioning of the paper triangle near the MS inlet. Future efforts will focus on improving the repeatability of PSI-MS as well as analyzing other species of interest such as cerium and uranium. Improvements will also be made to create more reliable data extraction and intelligent data filtering.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Summer 2021 Internship Report

During this internship program, I was assigned with developing a Web application to robustify web resources referenced by links (URI-Rs) in PDFs. It was intended for use in LANL Research 2 Library systems such as RASSTI (Review and Approval System for Scientific and Technical Information), where users submit scholarly PDFs that may contain URI-Rs. For such PDFs, the application should, using Web Archives, create robust snapshots (i.e., Mementos) of the web resources referenced by URI-Rs, and notify this robustification to LANL Research Library systems. The Mementos were to be created using the Robust Links Service, and the notifications were to be sent using the Linked Data Notifications (LDN) Protocol.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

Nuclear Physics Network Requirements Review Report

The Energy Sciences Network (ESnet) is the Office of Science’s high-performance network user facility, delivering highly reliable data transport capabilities optimized for the requirements of data-intensive science. In essence, ESnet is the circulatory system that enables the U.S. Department of Energy (DOE) science mission by connecting each and every DOE lab and its user facilities. ESnet is funded and stewarded by the Advanced Scientific Computing Research (ASCR) Program and managed and operated by the Scientific Networking Division at Lawrence Berkeley National Laboratory (LBNL). ESnet is widely regarded as a global leader in the research and education networking community. ESnet connects DOE national laboratories, user facilities, and major experiments so scientists can use remote instruments and computing resources as well as share data with collaborators, transfer large data sets, and access distributed data repositories. While ESnet provides network connectivity, it cannot be characterized as an internet service provider as it is specifically built to provide a range of network services that are tailored to meet the unique requirements of DOE’s data-intensive science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Trust Not Verify? The Critical Need for Data Curation Standards in Materials Informatics

The importance of data curation has been recognized in multiple areas of research; however, the discussion of this important issue is only beginning to emerge in materials science. In this Perspective, we highlight the benefits of using the standardized data curation protocols in materials science and discuss current gaps in accurate and reproducible data reporting using case studies drawn from high-impact materials science papers and well-known databases such as the Crystallography Open Database (COD) and the Cambridge Structural Database (CSD). We argue that both experimental and computational materials scientists need to embrace a culture of rigorous data curation as part of modern research data management. We propose a sample data curation pipeline for materials chemistry and illustrate its use by creating two new materials chemistry databases. Here, we hope that this perspective will serve to catalyze further discussion and promote the continuous development of rigorous data curation practices within the materials science research community. We posit that adherence to best practices of data curation will promote and enhance the reliability, reproducibility, and integrity of materials research and enable the development of reliable AI and machine learning models that critically depend on the use of quality data.

Chemical structure↗
DOE OSTI2022

Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computing Facility (OLCF), however, we unveiled user behavior about the Summit supercomputer by collecting data from a user’s point of view with ordinary Unix commands.In this paper, we discuss the process, challenges, and lessons learned while preparing this dataset for publication and submission to an open data challenge. The original dataset contains personal identifiable information (PII) about the users of OLCF which needed be masked prior to publication, and we determined that anonymization, which scrubs PII completely, destroyed too much of the structure of the data to be interesting for the data challenge. We instead chose to pseudonymize the dataset, which reduced the linkability of the dataset to the users’ identities. Pseudonymization is significantly more computationally expensive than anonymization, and the size of our dataset, which is approximately 175 million lines of raw text, necessitated the development of a parallelized workflow that could be reused on different HPC machines. We demonstrate the scaling behavior of the workflow on two leadership class HPC systems at OLCF, and we show that we were able to bring the overall makespan time from an impractical 20+ hours on a single node down to around 2 hours. As a result of this work, we release the entire pseudonymized dataset and make the workflows and source code publicly available.

Maheshwari, Ketan↗
DOE OSTI2023

BOXKIT

SF-23-067 BoxKit is a library that provides building blocks to parallelize and scale data science, high performance computing, and machine learning applications for block-structured datasets. Spatial data from simulations and experiments can be accessed and managed using tools available in this library when working with more data analysis oriented packages like SciKit (https://github.com/scikit-learn/scikit-learn) and FlowNet (https://github.com/NVIDIA/flownet2-pytorch)

DHRUV, AKASH↗