Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Data and scripts associated with “Moisture content modulates DOM thermodynamic regulation of oxygen consumption in drying streambed sediments”

This data package is associated with the publication “Moisture content modulates DOM thermodynamic regulation of oxygen consumption in drying streambed sediments” published in Scientific Reports (Garayburu-Caruso et al., 2026). The package contains processed data products and scripts used to quantify how drying and re-inundation of riverbed sediments influence dissolved organic matter (DOM) thermodynamic properties and their relationship with sediment oxygen (O₂) consumption across 33 stream sites in the contiguous United States. The data package contains DOM thermodynamic metrics (e.g., Gibbs free energy of carbon oxidation and thermodynamic efficiency), and O₂ consumption along with watershed-scale climate and land-cover metrics used as explanatory variables in the analyses. Underlying unprocessed and processed ultrahigh-resolution mass spectrometry data, oxygen consumption rates from laboratory moisture-manipulation experiments, within-sample environmental properties, sediment moisture content and contextual field measurements are archived separately at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/2428003 (Laan et al., 2024) and https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1923689 (Forbes et al.,2023). A preliminary version of this data package was published in February 2026 at the time of manuscript submission. It was updated in June 2026, at the time of manuscript acceptance, to include the finalized data and additional metadata (readme, data dictionary, and file level metadata). For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. At the top level, the data package is organized into five main folders: (1) Data, (2)Figures, (3) Map, (4) GAM_Reulsts, and (5) src. The Data folder contains analysis-ready tabular files with oxygen consumption rates, DOM thermodynamic properties by site and treatment, site-level environmental variables, watershed-scale metrics, and other derived variables referenced in the manuscript. The Figures folder contains static image files associated with the main text and supplemental figures, while the Map folder includes spatial data and map-layer files used to create the sampling-location map. The GAM results folder contains the results for each of the general additive model (GAM).The src folder contains R scripts used to perform data processing, statistical analyses (including clustering, generalized additive models, and threshold analysis), and figure generation. This data package is associated with a GitHub repository found at https://github.com/WHONDRS-Hub/ECA_DOM_Thermodynamics.

Dissolved organic matter↗

Utah FORGE: Neubrex Well 16B(78)-32 Circulation Test Fiber Optics Monitoring Data and Reports - July, 2023

This dataset features Distributed Acoustic Sensing (DAS) and fiber optics monitoring data acquired by Neubrex Energy Services during the Utah FORGE Well 16B(78)-32 circulation test in July 2023. DAS and fiber optic monitoring data include absolute strain, strain change, strain change rate, distributed temperature sensing (DTS), and frequency band extraction (FBE). Data processing was completed between September and October 2023. The dataset includes the fiber optic sensing data collected during these operations, along with a data collection report, descriptions of the data, and instructions for reading the data files.

15 GEOTHERMAL ENERGY↗

SPE2 Far-field Seismic Data Quicklook

The purpose of this report is to provide a brief overview of the far-field seismic data collected by the array of instruments (Figures 1 and 2) deployed by the Source Physics experiment for shots 1 (roughly 100 kg TNT equivalent at a depth of 60 m) and shot 2, (roughly 2000 kg TNT equivalent at a depth of 45 m). 'Far-field' is taken to refer to instruments in the zone of purely elastic response at distances of 100 m or greater. The primary focus is data from the main instrument array and hence data from other groups is not considered. Infrasound data is not addressed nor any remote sensing data. Data processing was done at LLNL in parallel with the effort at UNR. Raw reftek data was sent via hard disk from NsTec. Reftek data was converted to SEGY and then to SAC format. Data files were renamed according to station and channel information. Reftek logs were reviewed. These data have been reviewed for consistency with the UNR data on the server. The primary goal was quality check and a summary is provided in Tables 1 and 2.

58 GEOSCIENCES↗

Seismic Technology Adapted to Analyzing and Developing Geothermal Systems Below Surface-Exposed High-Velocity Rocks Final Report

The objective of our research was to develop and demonstrate seismic data-acquisition and data-processing technologies that allow geothermal prospects below high-velocity rock outcrops to be evaluated. To do this, we acquired a 3-component seismic test line across an area of exposed high-velocity rocks in Brewster County, Texas, where there is high heat flow and surface conditions mimic those found at numerous geothermal prospects. Seismic contractors have not succeeded in creating good-quality seismic data in this area for companies who have acquired data for oil and gas exploitation purposes. Our test profile traversed an area where high-velocity rocks and low-velocity sediment were exposed on the surface in alternating patterns that repeated along the test line. We verified that these surface conditions cause non-ending reverberations of Love waves, Rayleigh waves, and shallow critical refractions to travel across the earth surface between the boundaries of the fast-velocity and slow-velocity material exposed on the surface. These reverberating surface waves form the high level of noise in this area that does not allow reflections from deep interfaces to be seen and utilized. Our data-acquisition method of deploying a box array of closely spaced geophones allowed us to recognize and evaluate these surface-wave noise modes regardless of the azimuth direction to the surface anomaly that backscattered the waves and caused them to return to the test-line profile. With this knowledge of the surface-wave noise, we were able to process these test-line data to create P-P and SH-SH images that were superior to those produced by a skilled seismic data-processing contractor. Compared to the P-P data acquired along the test line, the SH-SH data provided a better detection of faults and could be used to trace these faults upward to the boundaries of exposed surface rocks. We expanded our comparison of the relative value of S-wave and P-wave seismic data for geothermal applications by inserting into this report a small part of the interpretation we have done with 3C3D data across Wister geothermal field in the Imperial Valley of California. This interpretation shows that P-SV data reveal faults (and by inference, also fractures) that cannot be easily, or confidently, seen with P-P data, and that the combination of P-P and P-SV data allows VP/VS velocity ratios to be estimated across a targeted reservoir interval to show where an interval has more sandstone (the preferred reservoir facies). The conclusion reached from this investigation is that S-wave seismic technology can be invaluable to geothermal operators. Thus we developed a strong interest in understanding the direct-S modes produced by vertical-force sources, particularly vertical vibrators, because if it can be demonstrated that direct-S modes produced by vertical-force sources can be used as effectively as the direct-S modes produced by horizontal-force sources, geothermal operators can acquire direct-S data across many more prospect areas than can be done with horizontal-force sources, which presently are limited to horizontal vibrators. We include some of our preliminary work in evaluating direct-S modes produced by vertical-force sources.

15 GEOTHERMAL ENERGY↗

Long–short-term memory encoder–decoder with regularized hidden dynamics for fault detection in industrial processes

The ability of recurrent neural networks (RNN) to model nonlinear dynamics of high dimensional process data has enabled data-driven RNN-based fault detection algorithms. Previous studies have focused on detecting faults by identifying the discrepancies in data distribution between the faulty and normal data, as reflected in prediction errors generated by RNN models. However, in industrial processes, variations in data distribution can also result from changes in normal control setpoints and compensatory control adjustments in response to disturbances, making it hard to differentiate between normal and faulty conditions. This paper proposes a fault detection method utilizing a long short-term memory (LSTM) encoder–decoder structure with regularized hidden dynamics and reversible instance normalization (RevIN) to compactly represent high-dimensional measurements for effective monitoring. During training, the hidden states of the model are regularized to form a low-dimensional latent space representation of the original multivariate time series data. As a result, the prediction errors of the latent states can be used to monitor the abnormal dynamic variations, while the reconstruction errors of the measured variables are used to monitor the abnormal static variations. Furthermore, the proposed indices can reflect operating conditions, even when the distribution of test data changes, which helps distinguish faults from normal adjustments and disturbances that controllers can settle. Here, data from numerical simulation and the Tennessee Eastman process are used to illustrate the effectiveness of the proposed fault detection method.

42 ENGINEERING↗

A programmable shared-memory system for an array of processing-in-memory devices

Processing in memory (PIM), the concept of integrating processing directly with memory has been attracting a lot of attention, since PIM can assist in overcoming the throughput limitation caused by data movement between CPU and memory. The challenge, however, is that it requires the programmers to have a deep understanding of the PIM architecture to maximize the benefits such as data locality and parallel thread execution on multiple PIM devices. In this study, we present AnalyzeThat, a programmable shared-memory system for parallel data processing with PIM devices. Thematic to AnalyzeThat is a rich PIM-aware data structure (PADS), which is an encapsulation that integrally ties together the data, the analysis tasks and the runtime needed to interface with the PIM device array. The PADS abstraction provides (i) a sophisticated key-value data container that allows programmers to easily store data on multiple PIMs, (ii) a suite of parallel operations with which users can easily implement data analysis applications, and (iii) a runtime, hidden to programmers, which provides the mechanisms needed to overlay both the data and the tasks on the PIM device array in an intelligent fashion, based on PIM-specific information collected from the hardware. We have developed a PIM emulation framework called AnalyzeThat. In conclusion, our experimental evaluation with representative data analytics applications suggests that the proposed system can significantly reduce the PIM programming effort without losing its technology benefits.

97 MATHEMATICS AND COMPUTING↗

Nuclear Data Resources for Capture gamma-Ray Spectroscopy and Related Topics

Nuclear reaction data play an important role in nuclear reactor, medical, and fundamental science and national security applications. The wealth of information is stored in internally adopted ENDF-6 and EXFOR formats. We present a complete calculation of resonance integrals, Westcott factors, thermal and Maxwellian-averaged cross sections for Z = 1-100 using evaluated nuclear reaction data. The addition of newly-evaluated neutron reaction libraries, and improvements in data processing techniques allows us to calculate nuclear industry and astrophysics parameters, and provide additional insights on all currently available neutron-induced reaction data. Nuclear reaction calculations will be discussed and an overview of the latest reaction data developments will be given.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

PRELIMINARY RESULTS FROM NEOWISE: AN ENHANCEMENT TO THE WIDE-FIELD INFRARED SURVEY EXPLORER FOR SOLAR SYSTEM SCIENCE

The Wide-field Infrared Survey Explorer (WISE) has surveyed the entire sky at four infrared wavelengths with greatly improved sensitivity and spatial resolution compared to its predecessors, the Infrared Astronomical Satellite and the Cosmic Background Explorer. NASA's Planetary Science Division has funded an enhancement to the WISE data processing system called 'NEOWISE' that allows detection and archiving of moving objects found in the WISE data. NEOWISE has mined the WISE images for a wide array of small bodies in our solar system, including near-Earth objects (NEOs), Main Belt asteroids, comets, Trojans, and Centaurs. By the end of survey operations in 2011 February, NEOWISE identified over 157,000 asteroids, including more than 500 NEOs and {approx}120 comets. The NEOWISE data set will enable a panoply of new scientific investigations.

79 ASTRONOMY AND ASTROPHYSICS↗

THE FIRST PUBLIC RELEASE OF SOUTH POLE TELESCOPE DATA: MAPS OF A 95 deg{sup 2} FIELD FROM 2008 OBSERVATIONS

The South Pole Telescope (SPT) has nearly completed a 2500 deg{sup 2} survey of the southern sky in three frequency bands. Here, we present the first public release of SPT maps and associated data products. We present arcminute-resolution maps at 150 GHz and 220 GHz of an approximately 95 deg{sup 2} field centered at R.A. 82.{sup 0}7, decl. -55 Degree-Sign . The field was observed to a depth of approximately 17 {mu}K arcmin at 150 GHz and 41 {mu}K arcmin at 220 GHz during the 2008 austral winter season. Two variations on map filtering and map projection are presented, one tailored for producing catalogs of galaxy clusters detected through their Sunyaev-Zel'dovich effect signature and one tailored for producing catalogs of emissive sources. We describe the data processing pipeline, and we present instrument response functions, filter transfer functions, and map noise properties. All data products described in this paper are available for download at http://pole.uchicago.edu/public/data/maps/ra5h30dec-55 and from the NASA Legacy Archive for Microwave Background Data Analysis server. This is the first step in the eventual release of data from the full 2500 deg{sup 2} SPT survey.

79 ASTRONOMY AND ASTROPHYSICS↗

A new CDF model for data movement based on SRM

Being a large international collaboration established well before the full development of the Grid as the main computing tool for High Energy Physics, CDF has recently changed and improved its computing model, decentralizing some parts of it in order to be able to exploit the rising number of distributed resources available nowadays. Despite those efforts, while the large majority of CDF Monte Carlo production has moved to the Grid, data processing is still mainly performed in dedicated farms hosted at FNAL, requiring a centralized management of data and Monte Carlo samples needed for physics analysis. This rises the question on how to manage the transfer of produced Monte Carlo samples from remote Grid sites to FNAL in an efficient way; up to now CDF has relied on a non scalable centralized solution based on dedicated data servers accessed through rcp protocol, which has proven to be unsatisfactory. A new data transfer model has been designed that uses SRMs as local caches for remote Monte Carlo production sites, interfaces them with SAM, the experiment data catalog, and finally realizes the file movement exploiting the features provided by the data catalog transfer layer. We describe here the model and its integration within the current CDF computing architecture.

99 GENERAL AND MISCELLANEOUS↗

GCAM 3.0 Agriculture and Land Use: Data Sources and Methods

This report presents the data processing methods used in the GCAM 3.0 agriculture and land use component, starting from all source data used, and detailing all calculations and assumptions made in generating the model inputs. The report starts with a brief introduction to modeling of agriculture and land use in GCAM 3.0, and then provides documentation of the data and methods used for generating the base-year dataset and future scenario parameters assumed in the model input files. Specifically, the report addresses primary commodity production, secondary (animal) commodity production, disposition of commodities, land allocation, land carbon contents, and land values.

54 ENVIRONMENTAL SCIENCES↗

Overhead longwave infrared hyperspectral material identification using radiometric models

Material detection algorithms used in hyperspectral data processing are computationally efficient but can produce relatively high numbers of false positives. Material identification performed as a secondary processing step on detected pixels can help separate true and false positives. This paper presents a material identification processing chain for longwave infrared hyperspectral data of solid materials collected from airborne platforms. The algorithms utilize unwhitened radiance data and an iterative algorithm that determines the temperature, humidity, and ozone of the atmospheric profile. Pixel unmixing is done using constrained linear regression and Bayesian Information Criteria for model selection. The resulting product includes an optimal atmospheric profile and full radiance material model that includes material temperature, abundance values, and several fit statistics. A logistic regression method utilizing all model parameters to improve identification is also presented. This paper details the processing chain and provides justification for the algorithms used. Several examples are provided using modeled data at different noise levels.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NGC 7097: THE ACTIVE GALACTIC NUCLEUS AND ITS MIRROR, REVEALED BY PRINCIPAL COMPONENT ANALYSIS TOMOGRAPHY

Three-dimensional spectroscopy techniques are becoming more and more popular, producing an increasing number of large data cubes. The challenge of extracting information from these cubes requires the development of new techniques for data processing and analysis. We apply the recently developed technique of principal component analysis (PCA) tomography to a data cube from the center of the elliptical galaxy NGC 7097 and show that this technique is effective in decomposing the data into physically interpretable information. We find that the first five principal components of our data are associated with distinct physical characteristics. In particular, we detect a low-ionization nuclear-emitting region (LINER) with a weak broad component in the Balmer lines. Two images of the LINER are present in our data, one seen through a disk of gas and dust, and the other after scattering by free electrons and/or dust particles in the ionization cone. Furthermore, we extract the spectrum of the LINER, decontaminated from stellar and extended nebular emission, using only the technique of PCA tomography. We anticipate that the scattered image has polarized light due to its scattered nature.

79 ASTRONOMY AND ASTROPHYSICS↗

Dataset for scientific paper "Simulated plant‑mediated oxygen input has strong impacts on fine‑scale porewater biogeochemistry and weak impacts on integrated methane fluxes in coastal wetlands", a modeling study based on field observation at the tidal salt marshes of the Parker River Estuary, Massachusetts, United States

This dataset is the raw and processed data for the paper "Simulated plant ‑ mediated oxygen input has strong impacts on fine ‑ scale porewater biogeochemistry and weak impacts on integrated methane fluxes in coastal wetlands". This study investigated how plant-mediated oxygen input affects subsurface biogeochemical reactions of organic carbon degradation and the resulting methane emissions of coastal wetlands by model simulation. We used the subsurface geochemical simulator PFLOTRAN for the modeling, which produced the simulated changes in porewater chemical substances and methane emissions over 10 days under different scenarios of plant-mediated oxygen input.Specifically, this dataset contains: 1) the input files for PFLOTRAN of all simulation runs conducted in this study. Those files are with an extension of ".in", containing information of the biogeochemical reaction network (stoichiometry, reaction rate, Monod constants, etc), fluid flow rate and oxygen concentration in the fluid which together simulated the plant-mediated oxygen input, the configuration of artificial reactions that simulated the methane fluxes, etc. The PFLOTRAN input files are text files, which can be opened by NotePad, but running these input files will require proper installation of PFLOTRAN (instruction: https://documentation.pflotran.org/user_guide/how_to/installation/installation.html). 2) the raw and processed model output from PFLOTRAN of all simulation runs, and 3) the python scripts used to process the raw model output, including random allocation of root cells, converting raw data into organized formats, calculating the methane fluxes based on the model output, data visualization, etc. The raw and processed model output from PFLOTRAN are in .spydata format, which can be viewed with Python. and 3) the python scripts for data processing and analysis are programming scripts, which can be opened with Python.This modeling work, in particular the model parameterization of root density and initial conditions of porewater concentrations of biogeochemical substances, was based on field measurements at the salt marsh of the Upper Parker River Estuary, Massachusetts, United States.

54 ENVIRONMENTAL SCIENCES↗

Revisiting low-fidelity two-fluid models for gas–solids transport

Two-phase gas–solids transport models are widely utilized for process design and automation in a broad range of industrial applications. Some of these applications include proppant transport in gaseous fracking fluids, air/gas drilling hydraulics, coal-gasification reactors and food processing units. Systems automation and real time process optimization stand to benefit a great deal from availability of efficient and accurate theoretical models for operations data processing. However, modeling two-phase pneumatic transport systems accurately requires a comprehensive understanding of gas–solids flow behavior. In this study we discuss the prevailing flow conditions and present a low-fidelity two-fluid model equation for particulate transport. The model equations are formulated in a manner that ensures the physical flux term remains conservative despite the inclusion of solids normal stress through the empirical formula for modulus of elasticity. A new set of Roe–Pike averages are presented for the resulting strictly hyperbolic flux term in the system of equations, which was used to develop a Roe-type approximate Riemann solver. The resulting scheme is stable regardless of the choice of flux-limiter. The model is evaluated by the prediction of experimental results from both pneumatic riser and air-drilling hydraulics systems. We demonstrate the effect and impact of numerical formulation and choice of numerical scheme on model predictions. We illustrate the capability of a low-fidelity one-dimensional two-fluid model in predicting relevant flow parameters in two-phase particulate systems accurately even under flow regimes involving counter-current flow.

42 ENGINEERING↗

The NIF 4.5-m nTOF Detectors

The first several campaigns of laser fusion experiments at the National Ignition Facility (NIF) included a family of high-sensitivity scintillator/photodetector neutron-time-of-flight (nTOF) detectors for measuring DD and DT neutron yields. The detectors provided consistent neutron yield benchmarks from below 1E9 (DD) to nearly 1E15 (DT). The detectors demonstrated DT yield measurement precisions better than 5%, but the absolute accuracy relies on cross calibration with independent measurements of absolute neutron yield. The 4.5-m nTOF data have provided a useful testbed for testing improvements in nTOF data processing, especially with respect to improving the accuracies of the detector impulse response functions. The resulting improvements in data analysis methods have produced more accurate results. In summary, results from the NIF 4.5-m nTOF detectors have provided consistent measurements of DD and DT neutron yields from laser-fusion implosions.

42 ENGINEERING↗

Utah FORGE: InSAR Data 2019

This dataset contains Interferometric Synthetic Aperture Radar (InSAR) data used for ground deformation monitoring during Phase 2C of the Utah FORGE project. The dataset includes measurements of the mean rate of range change and associated standard errors, provided in both CSV and NetCDF formats. Supporting materials include histograms, maps, and MATLAB scripts used for data processing, as well as unit vector information describing the satellite's sensor orientation. Compressed archives contain additional metadata and masked range change data for individual interferometric pairs. A README file is included to provide further details on the dataset's structure and contents.

15 GEOTHERMAL ENERGY↗

THE BOLOCAM GALACTIC PLANE SURVEY: SURVEY DESCRIPTION AND DATA REDUCTION

We present the Bolocam Galactic Plane Survey (BGPS), a 1.1 mm continuum survey at 33'' effective resolution of 170 deg{sup 2} of the Galactic Plane visible from the northern hemisphere. The BGPS is one of the first large area, systematic surveys of the Galactic Plane in the millimeter continuum without pre-selected targets. The survey is contiguous over the range -10.5 {<=} l {<=} 90.5, |b| {<=} 0.5. Toward the Cygnus X spiral arm, the coverage was flared to |b| {<=} 1.5 for 75.5 {<=} l {<=} 87.5. In addition, cross-cuts to |b| {<=} 1.5 were made at l= 3, 15, 30, and 31. The total area of this section is 133 deg{sup 2}. With the exception of the increase in latitude, no pre-selection criteria were applied to the coverage in this region. In addition to the contiguous region, four targeted regions in the outer Galaxy were observed: IC1396 (9 deg{sup 2}, 97.5 {<=} l {<=} 100.5, 2.25 {<=} b {<=} 5.25), a region toward the Perseus Arm (4 deg{sup 2} centered on l = 111, b = 0 near NGC 7538), W3/4/5 (18 deg{sup 2}, 132.5 {<=} l {<=} 138.5), and Gem OB1 (6 deg{sup 2}, 187.5 {<=} l {<=} 193.5). The survey has detected approximately 8400 clumps over the entire area to a limiting non-uniform 1{sigma} noise level in the range 11-53 mJy beam{sup -1} in the inner Galaxy. The BGPS source catalog is presented in a previously published companion paper. This paper details the survey observations and data reduction methods for the images. We discuss in detail the determination of astrometric and flux density calibration uncertainties and compare our results to the literature. Data processing algorithms that separate astronomical signals from time-variable atmospheric fluctuations in the data timestream are presented. These algorithms reproduce the structure of the astronomical sky over a limited range of angular scales and produce artifacts in the vicinity of bright sources. Based on simulations, we find that extended emission on scales larger than about 5.'9 is nearly completely attenuated (>90%) and the linear scale at which the attenuation reaches 50% is 3.'8. Comparison with other millimeter-wave data sets implies a possible systematic offset in flux calibration, for which no cause has been discovered. This presentation serves as a companion and guide to the public data release (http://irsa.ipac.caltech.edu/Missions/bolocam.html) through NASA's Infrared Processing and Analysis Center (IPAC) Infrared Science Archive (IRSA). New data releases will be provided through IPAC-IRSA with any future improvements in the reduction. The BGPS provides a complementary long-wavelength spectral band for the ongoing ATLASGAL and Herschel-SPIRE surveys, and an important database and context for imminent observations with SCUBA-2 and ALMA.

79 ASTRONOMY AND ASTROPHYSICS↗