Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Lessons Learned from Ecosystem-Scale Experimental Field Studies (Workshop Report)

Efforts to understand and predict ecosystem responses to environmental change require long-term, large-scale, spatially representative experiments and observations that capture natural variability, test predictive models, and generate transferable knowledge. Such studies are indispensable for unraveling the complexities of terrestrial ecosystems and their responses to disturbances and evolving environmental conditions, while generating the data necessary for developing mechanistic models and predictive tools that inform decision-making processes. Having a rich history of designing and executing large-scale ecosystem experiments, the U.S. Department of Energy’s Environmental System Science program convened a workshop in January 2025 that brought together leaders in the field to distill critical lessons from decades of experience in large-scale experiments. The workshop aimed to (1) provide an ecosystem experiment primer for best practices, thus ensuring a high scientific return on investment for funding agencies, and (2) offer a robust framework for the design and management of future research initiatives. This report synthesizes insights and experiences from workshop participants and is structured to capture the entire research life cycle, from goal setting and design to operations, adaptive management, team dynamics, collaborations, and the often overlooked aspect of decommissioning. By synthesizing decision-making and lessons learned across diverse research approaches, the report aims to provide a template of essential factors to consider when designing successful long-term, large-scale ecosystem experiments.

54 ENVIRONMENTAL SCIENCES↗

tbsinp (00)

The ice nucleation spectrometer (INS) is an offline analytical measurement system used to process filter samples for freezing temperature spectra of immersion-mode ice-nucleating particle (INP) number concentrations. It is almost identical to the Colorado State University (CSU) ice spectrometer design. The INS-AIR is specific to filter samples collected on aerial platforms, such as the DOE ARM tethered balloon system (TBS) operated by Sandia National Laboratories, using miniaturized aerosol filter samplers. Users are referred to the INS instrument handbook for INS-AIR sampler details. INS-AIR filter samples are collected during intensive operational periods at various ARM sites and then processed on the INS at CSU. This filter log contains the detailed metadata at all ARM sites where INP filter sample collection has occurred or is currently ongoing, including both ground-based routine INP sampling (INS) and TBS INP sampling (INS-AIR). Metadata include start and end times, vacuum line pressures and temperatures, and flow rates; total accumulated flow through each filter; and notes on collection issues or weather conditions. Users can also keep up to date with the status of filter and data processing, even before data are available on ARM’s Data Discovery. Users can contact INP mentors Jessie Creamean or Thomas Hill with any questions.

54 ENVIRONMENTAL SCIENCES↗

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗

Physics guided machine learning using simplified theories

Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this Letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplified theories with the underlying learning process. To emphasize their physical importance, our architecture consists of adding certain features at intermediate layers rather than in the input layer. To demonstrate our approach, we select a canonical airfoil aerodynamic problem with the enhancement of the potential flow theory. We include the features obtained by a panel method that can be computed efficiently for an unseen configuration in our training procedure. By addressing the generalizability concerns, our results suggest that the proposed feature enhancement approach can be effectively used in many scientific machine learning applications, especially for the systems where we can use a theoretical, empirical, or simplified model to guide the learning module.

42 ENGINEERING↗

EPCAPE Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) user facility recently deployed its First ARM Mobile Facility (AMF1) to La Jolla, California as part of the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) campaign. Some of the goals behind EPCAPE were to characterize the diurnal and seasonal cycles of stratocumulus clouds and to investigate the cloud-aerosol-radiation interactions and feedbacks in the area. The deployment of the AMF1 for a full year from 15 February 2023 to 14 February 2024 aided in addressing these scientific questions. While AMF1 collected data year-round, enhanced measurements were taken during two intensive operational periods (IOPs). The first IOP occurred from April to June and focused on the chemistry of low clouds (EPCAPE_Chem), while the second IOP occurred from July to September and was focused on the radiation of high clouds (EPCAPE_Radiation). Several cloud radars were deployed with AMF1 to collect valuable data on cloud properties that will help users address key science objectives. As in past ARM campaigns, a1-level radar data is extensively analyzed and calibration techniques are performed to generate b1-level data (Matthews et al. 2023, Feng et al. 2024). Radar data at the b1-level are of the highest quality and thus can be used to examine scientific questions. The status of the a1-level data and the a1-to-b1 process for the EPCAPE radars is subsequently detailed in this document.

54 ENVIRONMENTAL SCIENCES↗

Decentralized digital twins of complex dynamical systems

Abstract In this article, we introduce a decentralized digital twin (DDT) modeling framework and its potential applications in computational science and engineering. The DDT methodology is based on the idea of federated learning, a subfield of machine learning that promotes knowledge exchange without disclosing actual data. Clients can learn an aggregated model cooperatively using this method while maintaining complete client-specific training data. We use a variety of dynamical systems, which are frequently used as prototypes for simulating complex transport processes in spatiotemporal systems, to show the viability of the DDT framework. Our findings suggest that constructing highly accurate decentralized digital twins in complex nonlinear spatiotemporal systems may be made possible by federated machine learning.

97 MATHEMATICS AND COMPUTING↗

Equilibrium, Kinetic and Thermodynamic Studies Of Lead (II) Sorption on Hydrolyzed Starch Graft Copolymers

Hydrolyzed starch graft poly (acrylic acid) and starch graft poly(acrylonitrile) copolymers were used as a sorbents for the removal of Pb(II) from aqueous solution in batch process. The sorbents were characterized by scanning electron microscopy, Fourier transform infrared spectroscopy and thermogravimetric analysis. The effect of contact time, initial concentration and temperature were assessed to optimize the conditions for maximum sorption of the metal ions. The experimental data were analyzed by Langmuir, Freundlich, Temkin, Dubinin Radushkevich and Sips isotherm models. The Freundlich and the Sips isotherms confirmed the applicability of the models. The sorption capacity of the sorbent was found to be 118.61 mg/g for starch graft poly (acrylic) acid and 115.83 mg/g for starch graft poly (acrylonitrile). The Sorption kinetics was assessed by Lagergren pseudo first order, pseudo second order, Elovich equation, Intraparticle diffusion and the liquid film diffusion models. The experimental data fitted very well with the Elovich equation and the Intraparticle kinetic models. The thermodynamic analysis showed that the sorption was a spontaneous and endothermic process. The results indicated that starch graft copolymers can be used as an effective sorbents for Pb (II) removal from aqueous media.

36 MATERIALS SCIENCE↗

Model Data Archive for Manuscript Titled "Evaluation of a Coupled Surface–Subsurface Hydrologic Model Using Dense Water‑Level Sensors in a Mixed Urban–Rural Watershed"

This archive provides scripts, input files, and datasets used for the implementation and evaluation of a fully coupled surface–subsurface hydrologic model in the Neches River Basin, southeast Texas. The study uses the Advanced Terrestrial Simulator (ATS) to simulate coupled surface–subsurface hydrologic processes over a mixed urban–rural watershed and evaluates model performance using a dense network of 136 in situ water-level sensors, nine U.S. Geological Survey (USGS) stream gauges, and SSEBop-derived evapotranspiration estimates during the period October 2014–June 2024. The workflow is implemented primarily in Python 3 using the Watershed Workflow package. The Jupyter notebooks can be executed using open-source software such as Anaconda JupyterLab or Visual Studio Code. Other data files include TXT, CSV, XML, SHP, TIF, NetCDF, HDF5, and ExodusII files, which can be processed using the provided Python scripts. ATS input files are provided in XML format and can be edited using any commonly used text editor. This archive contains: *Scripts and input files used to generate the ATS model setup, including watershed discretization, mesh generation, parameter mapping, and model configuration. *Jupyter notebooks used for preprocessing observational data, evaluating streamflow, water levels, and evapotranspiration, computing performance metrics, and generating the figures presented in the manuscript. *ATS simulation outputs and processed observational datasets, including OneRain and DD6 water-level sensors, USGS streamflow observations, GIS data, and supporting spatial datasets used throughout the study.

Dense water-level sensor network↗

A Gaussian process guide for signal regression in magnetic fusion

Extracting reliable information from diagnostic data in tokamaks is critical for understanding, analyzing, and controlling the behavior of fusion plasmas and validating models describing that behavior. Recent interest within the fusion community has focused on the use of principled statistical methods, such as Gaussian process regression (GPR), to attempt to develop sharper, more reliable, and more rigorous tools for examining the complex observed behavior in these systems. While GPR is an enormously powerful tool, there is also the danger of drawing fragile, or inconsistent conclusions from naive GPR fits that are not driven by principled treatments. Here we review the fundamental concepts underlying GPR in a way that may be useful for broad-ranging applications in fusion science. We also revisit how GPR is developed for profile fitting in tokamaks. We examine various extensions and targeted modifications applicable to experimental observations in the edge of the DIII-D tokamak. Finally, we discuss best practices for applying GPR to fusion data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

High Performance Computing Facility Operational Assessment 2022: Oak Ridge Leadership Computing Facility

The Oak Ridge Leadership Computing Facility (OLCF) was established to accelerate scientific discovery by providing world-leading computational performance and advanced data infrastructure. As a US Department of Energy (DOE) Office of Science user facility, the OLCF has managed the successful deployment and operation of a succession of leadership-class resources dedicated to open science. In addition to these resources, the OLCF staff continually strive to develop innovative processes and technologies, improve security, and empower users through allocation management and comprehensive user support and training. These efforts support the advancement of science by the OLCF users and benefit high-performance computing (HPC) facilities around the world. In calendar year (CY) 2022, the OLCF supported 1,681 users and 570 projects and exceeded all targets for user satisfaction. The facility received an average satisfaction score of 4.6 out of 5 on the annual user survey, and 96% of respondents reported a high satisfaction rate with the OLCF overall. Of the 3,212 user tickets submitted in CY 2022, OLCF staff resolved 97% within 3 business days. The facility also introduced several new services for users this year, including weekly virtual office hours with subject matter experts from ORNL and vendor partners; new views in MyOLCF that allow users to analyze allocation and compute usage for a project; the ability to build and run containers on Summit; and improved data visualization support and training resources.

97 MATHEMATICS AND COMPUTING↗

Microstructure Stability During Creep of Friction Stir Welded AA2024-T3 Alloy

The poor weldability of the AA2024 aluminum alloy limits its use in industrial applications. Because friction stir welding (FSW) is a non-fusion welding process, it seems to be a promising solution for welding this alloy. In the current study, FSW was applied to butt weld AA2024-T3 aluminum alloy plates. Creep tests were conducted at 250 and at 315 °C on both the parent material and the friction stir welded specimens. The microstructures of the welded and non-welded AA2024-T3 specimens before and after the creep tests were studied and compared. A comprehensive transmission electron microscopy study together with a high-resolution scanning electron microscopy study and energy-dispersive x-ray spectroscopy analysis was conducted to investigate the microstructure stability. The parent material seems to contain two kinds of Cu-rich precipitates—coarse precipitates of a few microns each and uniformly dispersed fine nanosized precipitates. Unlike the parent material, the crept specimens were found to contain the two kinds of precipitates mentioned above together with platelet-like precipitates. In addition, extensive decoration of the grain boundaries with precipitates was clearly observed in the crept specimens. Controlled aging experiments for up to 280 h at the relevant temperatures were conducted on both the parent material and the welded specimens in order to isolate the contribution of exposure to high temperatures to the microstructure changes. TEM study showed the development of dislocation networks into a cellular dislocation structure in the case of the parent metal. Changes in the dislocation structure as a function of the creep strain and the FSW process were recorded. A detailed creep data analysis was conducted, taking into account the instability of the microstructure.

36 MATERIALS SCIENCE↗

Accurate flux predictions using tissue-specific gene expression in plant metabolic modeling

The accurate prediction of complex phenotypes such as metabolic fluxes in living systems is a grand challenge for systems biology and central to efficiently identifying biotechnological interventions that can address pressing industrial needs. The application of gene expression data to improve the accuracy of metabolic flux predictions using mechanistic modeling methods such as flux balance analysis (FBA) has not been previously demonstrated in multi-tissue systems, despite their biotechnological importance. We hypothesized that a method for generating metabolic flux predictions informed by relative expression levels between tissues would improve prediction accuracy. Relative gene expression levels derived from multiple transcriptomic and proteomic datasets were integrated into FBA predictions of a multi-tissue, diel model of Arabidopsis thaliana’s central metabolism. This integration dramatically improved the agreement of flux predictions with experimentally based flux maps from 13 C metabolic flux analysis compared with a standard parsimonious FBA approach. Disagreement between FBA predictions and MFA flux maps was measured using weighted averaged percent error values, and for parsimonious FBA this was 169%–180% for high light conditions and 94%–103% for low light conditions, depending on the gene expression dataset used. This fell to 10%-13% and 9%-11% upon incorporating expression data into the modeling process, which also substantially altered the predicted carbon and energy economy of the plant.

59 BASIC BIOLOGICAL SCIENCES↗

Big data health physics: a case study in operational health physics

This paper, written as a two part project as required by Illinois Institute of Technology’s Phys597 Reading & Special Problems class and health physics professional master’s program, focuses on the results of a prototype data collection process implemented at a Los Alamos National Laboratory facility. In particular, this paper examines the data in a statistical context in an effort to optimize operational health physics processes at the Los Alamos National Laboratory.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Final Report: Next Generation Diamond Drumhead X-Ray Optics

Problem / Opportunity Statement: Future high-impact scientific applications at synchrotron and Free-Electron Laser (FEL) X-ray sources require the development of processing and mounting methods for ultra-thin diamond crystals to meet the most challenging needs of pioneering research at next generation light source facilities. These methods should be capable of manufacturing crystal plates as thin as 10 micrometers over an area of a few mm2, and with a surface cut in different crystal orientations, such as the diamond {100}, {111}, {110} and {113} planes. Project Purpose and Approach: In Phase I, Great Lakes Crystal Technologies (GLCT) partnered with Stonybrook University (SUNY) to created thin diamond drumhead crystals. The purpose of the Phase I project is to transfer the drumhead membrane window etching technology from SUNY to GLCT. Testing of a device using the beamline at Stanford Linear Accelerator Laboratory was initially planned, however, a delay on the part of a third party service provided required us to get beamline testing done at Argonne National Laboratory. Phase I Taskwork: Testing of a high purity diamond plate thinning and etching process was performed. By SUNY and GLCT. Plates were sent to a third party service provider for thinning to ~100 microns, however, delays required that GLCT develop an in-house thinning process to complete the taskwork. GLCT successfully developed this in-house capability even though it was initially planned to be part of the Phase II Taskwork. Multiple practice and deliverable plates were provided to SUNY to be etched into the target drumhead devices. GLCT practiced and refined an in-house plate thinning process and produced five plates with thicknesses in the 60 – 150 micron range. Processing of the plates has begun and will continue in a no-cost extension period necessitated by the third party service provider delay. GLCT also procured and installed a reactive ion etching/inductively coupled plasma system. In addition, one of the thinned plates was measured at the Applied Photon Source at APL for a pre-processing assessment of the crystalline strain. After processing the plate into a drumhead and annealing, a post-processing assessment of the strain will be performed. Phase I Results: The initial data from GLCT’s plate thinning process development, SUNY’s drumhead etching processing, and characterization at APS/ANL demonstrate our teams capabilities to achieve the project goals. Commercial Applications & Benefits: The proposed technology will benefit advanced x-ray science performed at BNL and the 70+ additional advanced beamlines around the world. There are also a number of medical and homeland security applications which could benefit from the technology.

Quayle, Paul↗

Overview of a Methodology for Calculating the A Priori Scan Minimum Detectable Concentration for Post-Processed Radiological Surveys (Final Report) (Rev.1)

Increased continuous data collection using automated data loggers and autonomous radiological survey devices or vehicles has introduced a need for corresponding guidance and statistical techniques for data that are collected without surveyor vigilance. This report presents a method for calculating the a priori scan minimum detectable concentrations (MDCs) for surveys performed without vigilance similar to methods described in the Multi-Agency Radiation Survey and Site Investigation Manual, NUREG-1507, and NUREG/CR-6364. A priori scan MDCs are calculated during survey planning to ensure that survey parameters (e.g., scanning speed, scanning altitude, detector geometry) will lead to collecting data in which potentially contaminated areas can be detected when data are processed after the survey, within acceptable statistical error probabilities.

54 ENVIRONMENTAL SCIENCES↗

U.S. Agrivoltaics Irradiance Database

This is a foundational data set for research and deployment of agrivoltaics, which is the co-location of agriculture and solar power plants on the same land. This irradiance and shading dataset can be utilized to determine the suitability of agrivoltaics configurations for a given region and crop-type. The data is hourly, 4x4 km resolution across the contiguous United States and Hawaii. It is calculated from the National Solar Radiation Database sites, using the System Advisor Model (SAM) to simulate the shading patterns for 10 common agrivoltaics configurations. Sunlight availability data is reported for 10 locations on the ground between adjacent rows of solar panels, as well as averaged across areas of interest such as the average irradiance in the edge-to-edge open area or across 3-6 planting beds. Other available metrics include the input meteorological data from the NSRDB (e.g. global horizontal irradiance, wind speed, etc.) and estimates for comparing energy and agricultural characteristic across the 10 configurations, including power output per acre or per kW installed capacity and farmable land area per acre.

14 SOLAR ENERGY↗

Holographic Detector for Clouds (HOLODEC) droplet size distributions

The Holographic Detector for Clouds (HOLODEC) measures droplets of the size range 6 micron up to 1000 mm in an instantaneous sample volume. Measurement rate is 3.3 Hz in raw resolution; here the data is averaged over 1 s. The analysis is a combination of automatic and manual processing; details can be found in the file header.

54 ENVIRONMENTAL SCIENCES↗