SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

All sources NASA NTRS DOE OSTI

DOE OSTI2018

Performance Analysis, Design Considerations, and Applications of Extreme-Scale In Situ Infrastructures

A key trend facing extreme-scale computational science is the widening gap between computational and I/O rates, and the challenge that follows is how to best gain insight from simulation data when it is increasingly impractical to save it to persistent storage for subsequent visual exploration and analysis. One approach to this challenge is centered around the idea of in situ processing, where visualization and analysis processing is performed while data is still resident in memory. This paper examines several key design and performance issues related to the idea of in situ processing at extreme scale on modern platforms: Scalability, overhead, performance measurement and analysis, comparison and contrast with a traditional post hoc approach, and interfacing with simulation codes. We illustrate these principles in practice with studies, conducted on large-scale HPC platforms, that include a miniapplication and multiple science application codes, one of which demonstrates in situ methods in use at greater than 1M-way concurrency.

Ayachit, Utkarsh↗

DOE OSTI2021

Increasing freshwater and dissolved organic carbon flows to Northwest Alaska’s Elson lagoon

Manifestations of climate change in the Arctic are numerous and include hydrological cycle intensification and permafrost thaw, both expected as a result of atmospheric and surface warming. Across the terrestrial Arctic dissolved organic carbon (DOC) entrained in arctic rivers may be providing a carbon subsidy to coastal food webs. Yet, data from field sampling is too often of limited duration to confidently ascertain impacts of climate change on freshwater and DOC flows to coastal waters. This study applies numerical modeling to investigate trends in freshwater and DOC exports from land to Elson Lagoon in Northwest Alaska over the period 1981-2020. While the modeling approach has limitations, the results point to significant increases in freshwater and DOC exports to the lagoon over the past four decades. The model simulation reveals significant increases in surface, subsurface (suprapermafrost), and total freshwater exports. Significant increases are also noted in surface and subsurface DOC production and export, influenced by warming soils and associated active-layer thickening. The largest changes in subsurface components are noted in September, which has experienced a ~50% increase in DOC export emanating from suprapermafrost flow. Direct coastal suprapermafrost freshwater and DOC exports in late summer more than doubled between the first and last five years of the simulation period, with a large anomaly in September 2019 representing a more than fourfold increase over September direct coastal export during the early 1980s. These trends highlight the need for dedicated measurement programs that will enable improved understanding of climate change impacts on coastal zone processes in this data sparse region of Northwest Alaska.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Quasielastic least-squares reverse time migration of PS reflections

Conventional analysis of amplitude variation with offset for elastic PS reflections is based on analytical reflection coefficients in a layered medium, and wave-equation-based PS migration is mainly used to produce a structural image. To overcome this problem, we have developed a least-squares reverse time migration (LSRTM) method for elastic PS reflections based on a quasielastic wave equation. Here, the quasielastic wave equation can accurately model PS reflections with elastic amplitudes under the first-order Born approximation. Our LSRTM method inverts for perturbations of the S-wave velocity and density by minimizing the L 2 norm of the difference between recorded and predicted PS reflections modeled using a quasielastic wave equation. We refer to our new method as quasielastic LSRTM of PS reflections. Numerical tests on synthetic and field data indicate that our method can properly handle the amplitudes of elastic PS reflections and provides an accurate estimate of the perturbations of S-wave velocity and density. Extending the method to the 3D case is not straightforward and might require incorporating certain PS data processing techniques into the inversion itself.

58 GEOSCIENCES↗

DOE OSTI2023

CSAPR2 Optimized Convective Cell Tracking Data during TRACER

One of the challenges in analyzing convective cell properties is to observe the quick evolution of individual convective cells. While the operational radar data provide a volumetric data set to analyze radar observables of convective precipitation clouds, previous studies also suggested the quick evolution of cell life cycle that might not be captured by conventional radar volume scan strategies that take ~5-7 minutes. Aiming at enhancing our understanding of the links between convective cloud kinematic and microphysical processes as well as life cycles, the Tracking Aerosol Convection Interactions ExpeRiment (TRACER; Jensen et al. 2019) was conducted at Houston, Texas, in 2022. The TRACER campaign deployed the 2nd generation C-band Scanning ARM Precipitation Radar (CSAPR2), which performed frequent updates of range height indicator (RHI) and sector plan position indicator (PPI) scans to track individual convective cells every < 2 minutes, guided by a new cell tracking framework, Multisensor Agile Adaptive Sampling (MAAS; Kollias et al. 2020). This allows for capturing fast-evolving radar observables. We provide the processed CSAPR2 cell tracking data in CfRadial format collected during the TRACER field campaign from June to September 2022. The data files include processed radar variables: noise-masked reflectivity and differential reflectivity corrected for rain attenuation and systematic biases, noise-masked dealiased radial velocity, specific differential phase, locations of target cells (latitude, longitude, radar range), and radar-echo classification. Figure 1 provides an example of a 3D image of CSAPR2 reflectivity from the lowest PPI scan and an RHI scan after data processing.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Monotonic Gaussian Process for Physics-Constrained Machine Learning With Materials Science Applications

Physics-constrained machine learning is emerging as an important topic in the field of machine learning for physics. One of the most significant advantages of incorporating physics constraints into machine learning methods is that the resulting model requires significantly less data to train. By incorporating physical rules into the machine learning formulation itself, the predictions are expected to be physically plausible. Gaussian process (GP) is perhaps one of the most common methods in machine learning for small datasets. In this paper, we investigate the possibility of constraining a GP formulation with monotonicity on three different material datasets, where one experimental and two computational datasets are used. The monotonic GP is compared against the regular GP, where a significant reduction in the posterior variance is observed. The monotonic GP is strictly monotonic in the interpolation regime, but in the extrapolation regime, the monotonic effect starts fading away as one goes beyond the training dataset. Imposing monotonicity on the GP comes at a small accuracy cost, compared to the regular GP. The monotonic GP is perhaps most useful in applications where data are scarce and noisy, and monotonicity is supported by strong physical evidence.

36 MATERIALS SCIENCE↗

DOE OSTI2021

SFA-VirOmics

PNNL's Soil Microbiome Science Focus Area (SFA) is focused on understanding the basic biology underpinning how interactions among various soil microbial community members, across trophic levels, lead to the emergence of community functions. Moisture, in particular, drives microbial interactions and influences everything from cell function to substrate fate within soils. The group predicts this results in repeatable, predictable phenotypes. The sum of these phenotypes comprises the “soil metaphenome”. Understanding how the soil metaphenome shifts in response to moisture will provide a basis for modeling and predicting these shifts in reaction network responses. Visit the PNNL Soil Microbiome Science Focus Area Program homepage for more information. PNNL’s Soil Microbiome SFA Virome Dataset Annotation page is an extension to the PNNL Soil Microbiome SFA repository on DataHub allows for exploring and downloading integrated experimental omics dataset annotations, associated experimental metadata, pre- and post-processed viral data files, and other associated materials directly related to experimental viral project data.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Bayesian Statistical Analysis for Mass Spectrometric Data Processing

• Thermal ionization mass spectrometry (TIMS) is a “gold standard’ technique for actinide isotope amount ratio and assay measurements. • Ubiquitously used in: • Nuclear Nonproliferation • Nuclear Safeguards • Nuclear Forensics • Basic Science • Savannah River National Laboratory (SRNL) installed a new Thermo Scientific TRITON Plus TIMS in early 2024.

McLarty, Ellis C. [Savannah River National Laborat↗

DOE OSTI2025

Bayesian Statistical Analysis for Mass Spectrometric Data Processing

Thermal ionization mass spectrometry (TIMS) is a “gold standard’ technique for actinide isotope amount ratio and assay measurements. • Ubiquitously used in: • Nuclear Nonproliferation • Nuclear Safeguards • Nuclear Forensics • Basic Science • Savannah River National Laboratory (SRNL) installed a new Thermo Scientific TRITON Plus TIMS in early 2024.

McLarty, Ellis C. [Savannah River National Laborat↗

DOE OSTI2015

Models of lipid droplets growth and fission in adipocyte cells

Lipid droplets (LD) are spherical cellular inclusion devoted to lipids storage. It is well known that excessive accumulation of lipids leads to several human worldwide diseases like obesity, type 2 diabetes, hepatic steatosis and atherosclerosis. LDs' size range from fraction to one hundred of micrometers in adipocytes and is related to the lipid content, but their growth is still a puzzling question. It has been suggested that LDs can grow in size due to the fusion process by which a larger LD is obtained by the merging of two smaller LDs, but these events seems to be rare and difficult to be observed. Many other processes are thought to be involved in the number and growth of LDs, like the de novo formation and the growth through additional neutral lipid deposition in pre-existing droplets. Moreover the number and size of LDs are influenced by the catabolism and the absorption or interaction with other organelles. The comprehension of these processes could help in the confinement of the pathologies related to lipid accumulation. In this study the LDs' size distribution, number and the total volume of immature (n=12), mature (n=12, 10-days differentiated) and lipolytic (n=12) 3T3-L1 adipocytes were considered. More than 11,000 LDs were measured in the 36 cells after Oil Red O staining. In a previous work Monte Carlo simulations were used to mimic the fusion process alone between LDs. We found that, considering the fusion as the only process acting on the LDs, the size distribution in mature adipocytes can be obtained with numerical simulation starting from the size distribution in immature cells provided a very high rate of fusion events. In this paper Monte Carlo simulations were developed to mimic the interaction between LDs taking into account many other processes in addition to fusion (de novo formation and the growth through additional neutral lipid deposition in pre-existing droplets) in order to reproduce the LDs growth and we also simulated the catabolism (fission and the decrease through neutral lipid exit from pre-existing droplets) to reproduce their size reduction observed in lipolytic conditions. The results suggest that each single process, considered alone, can not be considered the only responsible for the size variation observed, but more than one of them, playing together, can quite well reproduce the experimental data. - Highlights: The growth and fission of the lipid droplets (LDs) were computationally simulated. To write and test the growth and fission models more than 110,000 LDs were measured. The usual processes considered alone, are not able to justify the experimental data. Some processes, playing together, can explain the growth and fission.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

ARM Cloud and Precipitation Measurements and Science Group (CPMSG) 2024 Workshop Report

The mission of the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility is to improve the understanding and representation of cloud and aerosol processes and their interaction with the Earth's surface in Earth system models (ESMs) by providing comprehensive field observations and supporting advanced data analytics. The ARM Cloud and Precipitation Measurements and Science Group (CPMSG) was chartered in March 2019 to help improve the performance and scientific impact of ARM measurements of clouds and precipitation. The group aims to identify and address gaps in measurement capabilities, maximize the scientific impact of ARM data, and effectively serve the scientific community. To achieve these goals, the group includes experts in cloud and precipitation science, as well as representatives from ARM infrastructure, including instrument mentors, engineers, data quality officers, and data product translators. Prior to CPMSG, early discussions on cloud and precipitation measurements primarily focused on improving radar systems, but have since evolved to include a broader scope involving radiometers and other instruments. Since its formation, the CPMSG has gathered feedback using science traceability matrices. CPMSG aims to keep these as living documents to show the measurement needs, scientific drivers, roadblocks, maturity of measurements and retrievals, and pathways to model improvements. The group meets quarterly to discuss and prioritize measurement and operational improvements.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

ARM Cloud and Precipitation Measurements and Science Group (CPMSG) 2024 Workshop Report

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

ARM Cloud and Precipitation Measurements and Science Group (CPMSG) 2024 Workshop Report

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Open Reproducible Electron Microscopy Data Analysis

Electron microscopy (EM) is a cornerstone technique in the materials and biological sciences capable of imaging structures at nano- to atomic-scale resolution. Advances in technologies mean that one acquires datasets at increasing data rates and sizes. These advancements present enormous opportunities for researchers to understand complex systems. However, processing the resulting large-scale, complex data in a reproducible and shareable way is a real challenge for researchers. The building, managing, and maintaining complex workflows in a reproducible manner requires extensive knowledge in several areas outside the researchers’ core skill sets, such as software engineering, data science, and high-performance computing (HPC). Our work demonstrates an innovative approach to solving these problems, enabling reproducible EM data analysis through container encapsulated pipelines. Using modern container technologies, we encapsulate processing elements and connect them using shared memory. We expose user-friendly, advanced algorithms and tools to allow end users to utilize without expert programming skills. The platform enables reproducible, scalable, shareable pipelines for the analysis and visualization of EM data. Focusing on interoperability, we leverage the DOE and other agencies’ existing investments to provide a powerful software platform for EM data analysis.

Harris, Christopher↗

DOE OSTI2021

Long-term leaf C:N ratio change under elevated CO 2 and nitrogen deposition in China: Evidence from observations and process-based modeling

Climate change, elevating atmosphere CO 2 (eCO 2 ) and increased nitrogen deposition (iNDEP) are altering the biogeochemical interactions between plants, microbes and soils, which further modify plant leaf carbon-nitrogen (C:N) stoichiometry and their carbon assimilation capability. Many field experiments have observed large sensitivity of leaf C:N ratio to eCO 2 and iNDEP. However, the large-scale pattern of this sensitivity is still unclear, because eCO 2 and iNDEP drive leaf C:N ratio toward opposite directions, which are further compounded by the complex processes of nitrogen acquisition and plant-and-microbial nitrogen competition. Here, we attempt to map the leaf C:N ratio spatial variation in the past 5 decades in China with a combination of data-driven model and process-based modeling. These two approaches showed consistent results. Over different regions, we found that leaf C:N ratio had significant but uneven changes between 2 time periods (1960-1989 and 1990-2015): a 5% ± 8% increase for temperate grasslands in northern China, a 3% ± 6% increase for boreal grasslands in western China, and by contrast, a 7% ± 6% decrease for temperate forests in southern China, and a 3% ± 5% decrease for boreal forests in northeastern China. Additionally, the structural equation models indicated that the leaf C:N change was sensitive to ΔNDEP, ΔCO 2 and ΔMAT rather than ΔMAP and ecosystem types. In this work, process-based modeling suggested that iNDEP was the main source of soil mineral nitrogen change, dominating leaf C:N ratio change in most areas in China, while eCO 2 led to leaf C:N ratio increase in low iNDEP area. This study also indicates that the long-term leaf C:N ratio acclimation was dominated by climate constraint, especially temperature, but was constrained by soil N availability over decade scale.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Ultrafast radiographic imaging and tracking: An overview of instruments, methods, data, and applications

Ultrafast radiographic imaging and tracking (U-RadIT) use state-of-the-art ionizing particle and light sources to experimentally study sub-nanosecond transients or dynamic processes in physics, chemistry, biology, geology, materials science and other fields. These processes are fundamental to modern technologies and applications, such as nuclear fusion energy, advanced manufacturing, communication, and green transportation, which often involve one mole or more atoms and elementary particles, and thus are challenging to compute by using the first principles of quantum physics or other forward models. One of the central problems in U-RadIT is to optimize information yield through, e.g. high-luminosity X-ray and particle sources, efficient imaging and tracking detectors, novel methods to collect data, and large-bandwidth online and offline data processing, regulated by the underlying physics, statistics, and computing power. We review and highlight recent progress in: (a.) Detectors such as high-speed complementary metal-oxide semiconductor (CMOS) cameras, hybrid pixelated array detectors integrated with Timepix4 and other application-specific integrated circuits (ASICs), and digital photon detectors; (b.) U-RadIT modalities such as dynamic phase contrast imaging, dynamic diffractive imaging, and four-dimensional (4D) particle tracking; (c.) U-RadIT data and algorithms such as neural networks and machine learning, and (d.) Applications in ultrafast dynamic material science using XFELs, synchrotrons and laser-driven sources. Hardware-centric approaches to U-RadIT optimization are constrained by detector material properties, low signal-to-noise ratio, high cost and long development cycles of critical hardware components such as ASICs. Interpretation of experimental data, including comparisons with forward models, is frequently hindered by sparse measurements, model and measurement uncertainties, and noise. Alternatively, U-RadIT make increasing use of data science and machine learning algorithms, including experimental implementations of compressed sensing. Machine learning and artificial intelligence approaches, refined by physics and materials information, may also contribute significantly to data interpretation, uncertainty quantification and U-RadIT optimization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Local Weather Station Design and Development for Cost-Effective Environmental Monitoring and Real-Time Data Sharing

Current weather monitoring systems often remain out of reach for small-scale users and local communities due to their high costs and complexity. This paper addresses this significant issue by introducing a cost-effective, easy-to-use local weather station. Utilizing low-cost sensors, this weather station is a pivotal tool in making environmental monitoring more accessible and user-friendly, particularly for those with limited resources. It offers efficient in-site measurements of various environmental parameters, such as temperature, relative humidity, atmospheric pressure, carbon dioxide concentration, and particulate matter, including PM 1, PM 2.5, and PM 10. The findings demonstrate the station’s capability to monitor these variables remotely and provide forecasts with a high degree of accuracy, displaying an error margin of just 0.67%. Furthermore, the station’s use of the Autoregressive Integrated Moving Average (ARIMA) model enables short-term, reliable forecasts crucial for applications in agriculture, transportation, and air quality monitoring. Furthermore, the weather station’s open-source nature significantly enhances environmental monitoring accessibility for smaller users and encourages broader public data sharing. With this approach, crucial in addressing climate change challenges, the station empowers communities to make informed decisions based on real-time data. In designing and developing this low-cost, efficient monitoring system, this work provides a valuable blueprint for future advancements in environmental technologies, emphasizing sustainability. The proposed automatic weather station not only offers an economical solution for environmental monitoring but also features a user-friendly interface for seamless data communication between the sensor platform and end users. This system ensures the transmission of data through various web-based platforms, catering to users with diverse technical backgrounds. Furthermore, by leveraging historical data through the ARIMA model, the station enhances its utility in providing short-term forecasts and supporting critical decision-making processes across different sectors.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2018

Advancing our predictive understanding of river corridor exchange

Despite decades of research, we lack an accurate framework to predict and manage hydrologic exchange in the river corridor and the associated ecosystem services and functions at the scales of stream reaches and entire networks. While many individual studies have been conducted to investigate specific mechanisms, they have not been synthesized to account for heterogeneity in space, nonstationarity, and multiscale feedbacks that typify the river corridor. As a result, contradictory predictions of exchange flux, geometry, and timescale are prevalent in the literature. We attribute these contradictions to (a) failure to account for multiscale feedbacks and (b) uncertainty in the information content of common measurement methods. Here, we apply the concept of interacting multiscale spatial and time‐variable domains to the river corridor to demonstrate why more complete multiscale characterization is necessary to achieve predictive understanding. Next, we highlight uncertainties and inconsistencies in measurement methods which may obfuscate our understanding of river corridor exchange. Finally, we briefly outline four necessary advances to achieve predictive understanding of river corridor exchange: standardization of metadata, critical evaluation of the information content and support volumes for measurement techniques, multiscale model‐data integration, and advancing theoretical models of river corridor exchange. This article is categorized under: Science of Water > Hydrological Processes Water and Life > Nature of Freshwater Ecosystems Science of Water > Methods

Ward, Adam S.↗

DOE OSTI2018

MSiReader v1.0: Evolving Open-Source Mass Spectrometry Imaging Software for Targeted and Untargeted Analyses

A major update to the mass spectrometry imaging (MSI) software MSiReader is presented, offering a multitude of newly added features critical to MSI analyses. MSiReader is a free, open-source, and vendor-neutral software written in the MATLAB platform and is capable of analyzing most common MSI data formats. A standalone version of the software, which does not require a MATLAB license, is also distributed. The newly incorporated data analysis features expand the utility of MSiReader beyond simple visualization of molecular distributions. The MSiQuantification tool allows researchers to calculate absolute concentrations from quantification MSI experiments exclusively through MSiReader software, significantly reducing data analysis time. An image overlay feature allows the incorporation of complementary imaging modalities to be displayed with the MSI data. A polarity filter has also been incorporated into the data loading step, allowing the facile analysis of polarity switching experiments without the need for data parsing prior to loading the data file into MSiReader. A quality assurance feature to generate a mass measurement accuracy (MMA) heatmap for an analyte of interest has also been added to allow for the investigation of MMA across the imaging experiment. Most importantly, as new features have been added performance has not degraded, in fact it has been dramatically improved. These new tools and the improvements to the performance in MSiReader v1.0 enable the MSI community to evaluate their data in greater depth and in less time. .

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗