Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Intelligent experiments through real-time AI: Fast Data Processing and Autonomous Detector Control for sPHENIX and future EIC detectors (Phase-I)

With an ever increasing demand for high precision data from modern detectors for discovery science and precision measurements, all major high energy nuclear and particle experiments, current and future, are facing the challenge on how to deal with the large volume of raw data generated from sophisticated state-of-the-art detectors in high rate collisions. These goals need to be balanced with available hardware and cost limits on DAQ (Data AcQuisition system) bandwidth and offline computing resources to capture, store and process the signal events. Two prototypical examples are the upcoming sPHENIX experiment, the DOE next generation heavy ion physics experiment at the Relativistic Heavy Ion Collider at BNL, and the future EIC experiments that are planned to be online circa 2030.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Core Model Proposal #410: Updates to Socioeconomic and Macroeconomic Data, Processing Structure, and Visualization

This Core Model Proposal (CMP) comprehensively restructures and updates the macroeconomic and socioeconomic modules in gcamdata. It includes visualizations of key data inputs, accounting identities, and data flows in the context of GCAM-Macro-KLEM. Major improvements include: (1) updating the Penn World Table (PWT) to version 10 and incorporating a new source, the Global Macro Database (GMD); (2) updating the SSP socioeconomics database from version 3.0.1 to 3.2; (3) introducing SSP-specific differentiation of employment and labor force data; (4) improving data integration between national accounts (from PWT, GMD, and GTAP) and GDP/population data from external sources; and (5) general data cleaning and structural refinements. We document the data sources and key assumptions used throughout the processing. These updates establish the foundation for the forthcoming KLEAM version of GCAM-macro.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Fibro: a fiber optic data processing software for unconventional reservoirs

Various embodiments of the present disclosure are directed to systems and methods for data collection using fiber-optic cable in a well, and analysis of the data to determine instantaneous frequency, instantaneous phase, instantaneous amplitude, and/or dominant frequency. These measures can be used to determine parameters associated with the operation of the well. The parameters can be used to control the operation of the well and/or the fracturing process.

Ghahfarokhi, Payam Kavousi↗
DOE OSTI2013

STANDARDIZING TYPE Ia SUPERNOVA ABSOLUTE MAGNITUDES USING GAUSSIAN PROCESS DATA REGRESSION

We present a novel class of models for Type Ia supernova time-evolving spectral energy distributions (SEDs) and absolute magnitudes: they are each modeled as stochastic functions described by Gaussian processes. The values of the SED and absolute magnitudes are defined through well-defined regression prescriptions, so that data directly inform the models. As a proof of concept, we implement a model for synthetic photometry built from the spectrophotometric time series from the Nearby Supernova Factory. Absolute magnitudes at peak B brightness are calibrated to 0.13 mag in the g band and to as low as 0.09 mag in the z = 0.25 blueshifted i band, where the dispersion includes contributions from measurement uncertainties and peculiar velocities. The methodology can be applied to spectrophotometric time series of supernovae that span a range of redshifts to simultaneously standardize supernovae together with fitting cosmological parameters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

North Slope of Alaska XSAPR b1 Data Processing Report: April 2024-April 2025

The North Slope of Alaska (NSA) atmospheric observatory, operated by the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) User Facility, is a measurement site in the Arctic that has been collecting crucial atmospheric data for more than 25 years. The central facility located in Utqiaġvik, Alaska (formerly known as Barrow) hosts a suite of instruments that are used to better understand arctic processes, which are often not well represented in earth system models. The NSA site sits only a few kilometers from the Arctic Ocean, which also makes it a prime location to study complex ocean-atmosphere-ice interactions. Arctic cloud and precipitation processes are also of scientific interest, and remote-sensing instruments including radars are a key component of the NSA instrument suite. One of the radars at NSA is the X-band Scanning ARM Precipitation Radar (XSAPR). This report evaluates one year of recent XSAPR data from April 2024 through April 2025 and details the process of generating b1-level data. This analysis marks the first effort by ARM staff to quality-control NSA XSAPR data with the goal of routinely producing b1-level data in the future depending on radar operations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

TRACER Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed the first ARM Mobile Facility (AMF1) to Houston, Texas for the Tracking Aerosol Convection Interactions Experiment (TRACER) field campaign. The TRACER campaign was conducted from October 1, 2021 to September 30, 2022, with an intensive operational period (IOP) from June 1 to September 30, 2022. To investigate the life cycles of convective cells in the polluted and humid urban environment of Houston, ARM deployed cloud and precipitation radars, including the C-band Scanning ARM Precipitation Radar (CSAPR2), the X/Ka-band Scanning ARM Cloud Radar (SACR), and the Ka-band ARM Zenith cloud Radar (KAZR), as shown in Figure 1. This report presents an analysis of radar data quality, hardware calibrations, and radar data corrections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Fixed-Site KAZR b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy’s (DOE) Atmospheric Radiation Measurement (ARM) User Facility operates three fixed-site observatories: Eastern North Atlantic (ENA), North Slope of Alaska (NSA), and Southern Great Plains (SGP). Each fixed site has a wide variety of atmospheric instrumentation that has been collecting data for at least 10 years (NSA and SGP over 25 years). Each site is unique because it represents a different climate state. The environment at ENA is characterized by marine stratocumulus clouds and one of the key scientific areas of focus is the interaction of these clouds with aerosols. At NSA the focus is on arctic climate and cloud and radiative processes in a high-latitude environment. SGP represents a mid-latitude, mid-continent climate that experiences environmental cycles on diurnal and seasonal time scales. The ARM observatories are all meant to improve understanding of atmospheric processes that can then be better incorporated into weather and climate models. Another common thread between the fixed sites is the focus on cloud processes. Each site is equipped with at least one radar that provides continuous remote-sensing observations of clouds and precipitation. This report details the analysis of a1-level radar data at the fixed sites and the process for generating b1-level data. While b1-level data have been produced for ARM campaigns at the mobile facilities, this is the first analysis led by ARM radar mentors to correct data at the fixed sites. In particular, we focus on calibrations and corrections of the Ka-band ARM Zenith Radars (KAZRs) at ENA, NSA, and SGP. Ongoing and future work will involve corrections applied to other fixed-site radars.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascale supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

North Slope of Alaska XSAPR b1 Data Processing Report: May 2025-April 2026

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility operates an X-band Scanning ARM Precipitation Radar (XSAPR) at the North Slope of Alaska (NSA) atmospheric observatory in Utqiaġvik. This radar provides year-round dual-polarization measurements of snow and ice in an arctic environment. Over the past few years, there has been greater focus on the NSA XSAPR, and recent efforts by ARM staff have resulted in quality-controlled, b-level data (Rocque et al. 2026b). This report outlines the processing of the second set of b-level data released for this radar from May 2025 through April 2026 following similar methods from Rocque et al. (2026b).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

A peak position comparison method for high-speed quantitative Laue microdiffraction data processing

Indexing Laue patterns of a synchrotron microdiffraction scan can take as much as ten times longer than collecting the data, impeding efficient structural analysis using this technique. Here in this paper, a novel strategy is developed. By comparing the peak positions of adjacent Laue patterns and checking the intensity sequence, grain and phase boundaries are identified, requiring only a limited number of indexing steps for each individual grain. Using this protocol, the Laue patterns can be indexed on the fly as they are taken. The validation of this method is demonstrated by analyzing the microstructure of a laser 3D printed multi-phase/multi-grain Ni-based superalloy.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Utah FORGE: Seismic DAS and Geophone Borehole Data Processing and 3D Imaging of Vp/Vs Ratio in the 2024 Stimulated Reservoir

This dataset includes a final report and a 3D velocity model derived from seismic DAS and geophone borehole data collected during the April 2024 stimulation of the reservoir at Utah FORGE. The report details the processing of over 50,000 P- and S-wave travel times used in a tomographic inversion to estimate the Vp/Vs ratio, revealing anomalies adjacent to wells 16A and 16B that may be associated with injected fracturing fluids. Additionally, Wadati analysis of more than 27,000 pairs of differential P- and S-wave travel times supports this interpretation with a high Vp/Vs estimate of 1.86, averaged over the dimensions of the earthquake cluster. The accompanying data file provides a 3D model of P- and S-wave velocities and Vp/Vs ratios, structured with spatial coordinates and velocity values.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

WormBase in 2022—data, processes, and tools for analyzing Caenorhabditis elegans

WormBase (www.wormbase.org) is the central repository for the genetics and genomics of the nematode Caenorhabditis elegans. We provide the research community with data and tools to facilitate the use of C. elegans and related nematodes as model organisms for studying human health, development, and many aspects of fundamental biology. Throughout our 22-year history, we have continued to evolve to reflect progress and innovation in the science and technologies involved in the study of C. elegans. We strive to incorporate new data types and richer data sets, and to provide integrated displays and services that avail the knowledge generated by the published nematode genetics literature. Here, we provide a broad overview of the current state of WormBase in terms of data type, curation workflows, analysis, and tools, including exciting new advances for analysis of single-cell data, text mining and visualization, and the new community collaboration forum. Concurrently, we continue the integration and harmonization of infrastructure, processes, and tools with the Alliance of Genome Resources, of which WormBase is a founding member.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Development and operational experience of the web based application to collect, manage, and release the alignment and calibration configurations for data processing at CMS

The alignment and calibration workflows at the Compact Muon Solenoid (CMS) experiment are fundamental to provide a high quality physics data and to maintain the design performance of the experiment. To facilitate the operational efforts required by the experiment, the alignment and calibration team has developed and deployed a set of web-based applications to search, navigate and prepare a consistent set of calibrations to be consumed in reconstruction of data for physics, accessible through the Condition DB Browser. The Condition DB Browser hosts also various data management tools, including a visualization tool that allows to easily inspect alignment an calibration contents, an user-defined notification agent for delivering updates on modification to the database, a logging service for the user and the automatic online-to-offline condition uploads. In this paper we report on the operational experience of this web application from 2017 data taking, with focus on new features and tools incorporated during this period.

Md, Hasbuddin↗
DOE OSTI2026

Fixed-Site KAZR b1 Data Processing Report: 2025

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility has been operating Ka-band ARM Zenith Radars (KAZRs) at each of its permanent observatories for at least the past 10 years. Data collected by the KAZRs is used to explore various cloud processes in different climatological regimes including marine stratocumulus clouds at the Eastern North Atlantic (ENA) site, arctic clouds at the North Slope of Alaska (NSA) site, and mid-latitude continental clouds at the Southern Great Plains (SGP) site.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Real-time data processing in the ALICE High Level Trigger at the LHC

At the Large Hadron Collider at CERN in Geneva, Switzerland, atomic nuclei are collided at ultra-relativistic energies. Many final-state particles are produced in each collision and their properties are measured by the ALICE detector. The detector signals induced by the produced particles are digitized leading to data rates that are in excess of 48 GB/s. The ALICE High Level Trigger (HLT) system pioneered the use of FPGA- and GPU-based algorithms to reconstruct charged-particle trajectories and reduce the data size in real time. The results of the reconstruction of the collision events, available online, are used for high level data quality and detector-performance monitoring and real-time time-dependent detector calibration. The online data compression techniques developed and used in the ALICE HLT have more than quadrupled the amount of data that can be stored for offline event processing.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

EPCAPE Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) user facility recently deployed its First ARM Mobile Facility (AMF1) to La Jolla, California as part of the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) campaign. Some of the goals behind EPCAPE were to characterize the diurnal and seasonal cycles of stratocumulus clouds and to investigate the cloud-aerosol-radiation interactions and feedbacks in the area. The deployment of the AMF1 for a full year from 15 February 2023 to 14 February 2024 aided in addressing these scientific questions. While AMF1 collected data year-round, enhanced measurements were taken during two intensive operational periods (IOPs). The first IOP occurred from April to June and focused on the chemistry of low clouds (EPCAPE_Chem), while the second IOP occurred from July to September and was focused on the radiation of high clouds (EPCAPE_Radiation). Several cloud radars were deployed with AMF1 to collect valuable data on cloud properties that will help users address key science objectives. As in past ARM campaigns, a1-level radar data is extensively analyzed and calibration techniques are performed to generate b1-level data (Matthews et al. 2023, Feng et al. 2024). Radar data at the b1-level are of the highest quality and thus can be used to examine scientific questions. The status of the a1-level data and the a1-to-b1 process for the EPCAPE radars is subsequently detailed in this document.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Consistent Chemical Mechanism from Collaborative Data Processing

Numerical tool of Process Informatics Model (PrIMe) is mathematically rigorous and numerically efficient approach for analysis and optimization of chemical systems. It handles heterogeneous data and is scalable to a large number of parameters. The Boundto-Bound Data Collaboration module of the automated data-centric infrastructure of PrIMe was used for the systematic uncertainty and data consistency analyses of the H 2 /CO reaction model (73/17) and 94 experimental targets (ignition delay times). The empirical rule for evaluation of the shock tube experimental data is proposed. The initial results demonstrate clear benefits of the PrIMe methods for an evaluation of the kinetic data quality and data consistency and for developing predictive kinetic models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗