Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Use of the ARM Measurements of Spectral Zenith Radiance for Better Understanding of 3D Cloud-Radiation Processes & Aerosol-Cloud Interaction

This project focuses on cloud-radiation processes in a general three-dimensional cloud situation, with particular emphasis on cloud optical depth and effective particle size. The proposal has two main parts. Part one exploits the large number of new wavelengths offered by the Atmospheric Radiation Measurement (ARM) zenith-pointing ShortWave Spectrometer (SWS), to develop better retrievals not only of cloud optical depth but also of cloud particle size. We also take advantage of the SWS’ high sampling resolution to study the “twilight zone” around clouds where strong aerosol-cloud interactions are taking place. Part two involves continuing our cloud optical depth and cloud fraction retrieval research with ARM’s 2-channel narrow field-of-view radiometer and sunphotometer instrument by, first, analyzing its data from the ARM Mobile Facility deployments, and second, making our algorithms part of ARM’s operational data processing.

54 ENVIRONMENTAL SCIENCES↗

Tensile tests of niobium material for SRF cavities

Mechanical tests of cavity-grade niobium samples were conducted to provide engineering information for the certification of 3rd-harmonic superconducting radio-frequency cavities and cryomodules. Large changes of mechanical properties occur throughout the cavity fabrication process due to the cold work introduced by forming, the heating introduced by electron beam welding, and the recovery of cold work during the anneal used to degas hydrogen after chemical processing. Data is provided here to show the different properties at various stages of fabrication, including both weld regions and samples from the bulk niobium far away from the weld. Measurements of RRR were used to assure that any contamination during annealing was negligible.

43 PARTICLE ACCELERATORS↗

A historical survey of algorithms and hardware architectures for neural-inspired and neuromorphic computing applications

In this study, biological neural networks continue to inspire new developments in algorithms and microelectronic hardware to solve challenging data processing and classification problems. Here in this research, we survey the history of neural-inspired and neuromorphic computing in order to examine the complex and intertwined trajectories of the mathematical theory and hardware developed in this field. Early research focused on adapting existing hardware to emulate the pattern recognition capabilities of living organisms. Contributions from psychologists, mathematicians, engineers, neuroscientists, and other professions were crucial to maturing the field from narrowly-tailored demonstrations to more generalizable systems capable of addressing difficult problem classes such as object detection and speech recognition. Algorithms that leverage fundamental principles found in neuroscience such as hierarchical structure, temporal integration, and robustness to error have been developed, and some of these approaches are achieving world-leading performance on particular data classification tasks. Additionally, novel microelectronic hardware is being developed to perform logic and to serve as memory in neuromorphic computing systems with optimized system integration and improved energy efficiency. Key to such advancements was the incorporation of new discoveries in neuroscience research, the transition away from strict structural replication and towards the functional replication of neural systems, and the use of mathematical theory frameworks to guide algorithm and hardware developments.

97 MATHEMATICS AND COMPUTING↗

Comparison of fiber-optic distributed temperature sensing and high-sensitivity sensor spatial surveying of stream temperature

Measuring surface water temperature spatial variability is needed to estimate the interaction between surface water and groundwater, evaluate fish habitat and thermal inertia, and to estimate streamflow frequency and duration. Fiber optic distributed temperature sensing (FO-DTS) has been used in rivers and lakes, providing high-resolution and sensitive temperature monitoring over large temporal and spatial scales. However, in streams with cobbly or bedrock-lined streambeds and variable bathymetry, use of FO-DTS to measure temperature close to the surface water and groundwater interface can be challenging if even feasible. FO-DTS can also be costly, involve difficult installations, and require an advanced understanding of the technology, calibration, and data processing. In this study, we compared FO-DTS stream temperature survey results to an alternative temperature survey method employing a towed transect of high-resolution temperature loggers spaced at 1-m and transported in the stream along the study reach, to measure the spatial distribution of stream-water temperature in East Fork Poplar Creek near Oak Ridge, Tennessee, USA. We assessed the applicability and limitations of the two methods, and quantitatively compared in-situ temperature survey results measured simultaneously with each method. Regression results showed strong temporal and spatial correlation between the two methods. Differences were only elevated near the stream banks in areas that were coincident with correlation slope deviations from unity, which was attributed to shallower water and lower data density. Kriging standard errors were also low at channel center with minor increases near the stream banks. Furthermore, the results suggested that the array of the individual temperature sensors can provide a practical alternative to FO-DTS for thermal characterization of surface water, providing slightly lower spatial and temporal resolution, but with higher accuracy of temperature measurement, with greater simplicity, and with a broader range of conditions where it may be applied.

54 ENVIRONMENTAL SCIENCES↗

Photovoltaic Shading Testbed for Module-Level Power Electronics: 2016 Performance Data Update

The 2012 NREL report 'Photovoltaic Shading Testbed for Module-Level Power Electronics' provides a standard methodology for estimating the performance benefit of distributed power electronics under partial shading conditions. Since the release of the report, experiments have been conducted for a number of products and for different system configurations. Drawing from these experiences, updates to the test and analysis methods are recommended. Proposed changes in data processing have the benefit of reducing the sensitivity to measurement errors and weather variability, as well as bringing the updated performance score in line with measured and simulated values of the shade recovery benefit of distributed PV power electronics. Also, due to the emergence of new technologies including sub-module embedded power electronics, the shading method has been extended to include power electronics that operate at a finer granularity than the module level. An update to the method is proposed to account for these emerging technologies that respond to shading differently than module-level devices. The partial shading test remains a repeatable test procedure that attempts to simulate shading situations as would be experienced by typical residential or commercial rooftop photovoltaic (PV) systems. Performance data for multiple products tested using this method are discussed, based on equipment from Enphase, Solar Edge, Maxim Integrated and SMA. In general, the annual recovery of shading losses from the module-level electronics evaluated is 25-35%, with the major difference between different trials being related to the number of parallel strings in the test installation rather than differences between the equipment tested. Appendix D data has been added in this update.

14 SOLAR ENERGY↗

Accurate Ultrasonic Thickness Measurement for Arbitrary Time-Variant Thermal Profile

Ultrasonic thickness measurement of mechanical structures is one of the most popular and commonly used nondestructive methods for various kinds of process control and corrosion monitoring. With ultrasonic propagation speed being temperature-dependent, the thickness measurement can be performed reliably only when the thermal profile is completely known. Most conventional techniques assume the temperature of the test structure is uniform and at room temperature across its thickness. Such assumptions may lead to large errors in the thickness measurement, especially when there are significant temperature variations across the thickness. State-of-the-art techniques use external temperature measurements or implement iterative methods to compensate for the unknown thermal profiles. However, such techniques produce unsatisfactory results when the heat distribution is complex or varies rapidly with time. In this work, we propose a two-sensors technique, using both compressive and shear excitations, with a non-iterative rapid data processing method for accurate thickness measurement under arbitrary time-variant thermal profile. The independent behavior of shear and compressive waves is used to formulate a real-time thickness estimation technique. The developed technique is experimentally validated on a steel plate with fixed acoustic sensors. Test results show that the error in thickness estimation can be reduced by up to 98% compared to conventional thickness gauging methods.

36 MATERIALS SCIENCE↗

MTUQ: a framework for estimating moment tensors, point forces, and their uncertainties

SUMMARY We introduce MTUQ, an open-source Python package for seismic source estimation and uncertainty quantification, emphasizing flexibility and operational scalability. MTUQ provides MPI-parallelized grid search and global optimization capabilities, compatibility with 1-D and 3-D Green’s function database formats, customizable data processing, C-accelerated waveform and first-motion polarity misfit functions, and utilities for plotting seismic waveforms and visualizing misfit and likelihood surfaces. Applicability to a range of full- and constrained-moment tensor, point force, and centroid inversion problems is possible via a documented application programming interface, accompanied by example scripts and integration tests. We demonstrate the software using three different types of seismic events: (1) a 2009 intraslab earthquake near Anchorage, Alaska; (2) an episode of the 2021 Barry Arm landslide in Alaska; and (3) the 2017 Democratic People’s Republic of Korea underground nuclear test. With these events, we illustrate the well-known complementary character of body waves, surface waves, and polarities for constraining source parameters. We also convey the distinct misfit patterns that arise from each individual data type, the importance of uncertainty quantification for detecting multimodal or otherwise poorly constrained solutions, and the software’s flexible, modular design.

58 GEOSCIENCES↗

Automated Model for Improved Mapping of Country-Scale High-Resolution Coastal Bathymetry

Accurate and up-to-date maps of coastal bathymetry are critical for a variety of sectors from vessel navigation to port construction and are increasingly vital to inform coastal infrastructure management amid accelerating sea-level rise and more frequent and severe storm-surge events. The primary challenges to accurate and efficient bathymetric mapping from optical remote sensing are: accurately modeling light attenuation in both the atmosphere and water column; and inefficient data processing pipelines for highresolution satellite imagery. To address the effects of light attenuation within the water-column we have developed a novel physics-based bathymetry model that accounts for variations in water-column inherent optical properties on a pixel-by-pixel basis in optically-shallow aquatic environments, which represents a major advancement. For applications to satellite imagery, we have developed a software package that automatically applies the robust 6S atmospheric correction algorithm, estimates the bottom depth from the physics-based bathymetry model, which corrects for attenuation by suspended particulate matter and colored dissolved organic matter in the water column on a pixel-by-pixel basis, and leverages highperformance computing for rapid application to region-scale (e.g., CONUS) 2-meter resolution imagery datasets. Our approach is tailored to sensors that collect data at two-meter resolution with high return times for frequent updates. We mapped 591 WorldView satellite images for Florida, North Carolina, and Alaska and validated the maps against LiDAR-derived bathymetry data. Results show median RMSE of 1.75, 1.59, and 2.67 meters, respectively. By combining the strengths of Oak Ridge National Laboratory in high-performance computing and remote-sensing science with the water-column modeling expertise of Scripps Institution of Oceanography we advance the state of bathymetric mapping capability.

54 ENVIRONMENTAL SCIENCES↗

Interactive Web Application for Traffic Simulation Data Management and Visualization

As traffic simulation software becomes more effective for realistically simulating and analyzing traffic dynamics and vehicle interactions on the mesoscopic and microscopic level, the management, dissemination, and collaborative visualization of traffic simulation results produced by individual transportation planners presents a significant challenge. Existing online content management systems have a very limited capability in allowing users to query specific traffic simulation scenarios and geospatially visualize simulation results through shareable and interactive web interfaces. This paper presents a web-based application for promoting the archiving, sharing, and visualization of large-scale traffic simulation outputs. The application is developed to enhance cyber-physical controls, communications, and public education for collaborative transportation planning. Unique features of the web application include: (a) allowing users to upload their new traffic simulation scenarios (parameters and outputs), as well as search existing scenarios using easily accessible interfaces; (b) optimizing simulation output files with heterogeneous data formats and projected coordinate systems for web-based storage and management using a scalable and searchable data/metadata standard; (c) standardizing user-uploaded simulation outputs using web interfaces and data processing libraries with parallel computing capacity; and (d) providing shareable web visual interfaces for visualizing the traffic flow and signal information stored in simulation outputs (e.g., regional traffic patterns and individual vehicle interactions) and visually comparing multiple simulation outputs both spatially and temporally. Furthermore, the paper presents the conceptual design and implementation of this application, and demonstrates the application’s performance for sharing, comparing, and visualizing simulation outputs from VISSIM and SUMO, two commonly used traffic simulation software programs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Validation of aerosol extinction and water vapor profiles from routine Atmospheric Radiation Measurement Climate Research Facility measurements

The accuracy with which vertical profiles of aerosol extinction σ ep (λ) can be retrieved from ARM Climate Research Facility (ACRF) routine measurements was assessed using data from two airborne field campaigns, the ARM Aerosol Intensive Operation Period (AIOP, May 2003), and the Aerosol Lidar Validation Experiment (ALIVE, September 2005). This assessment pertains to the aerosol at its ambient concentration and thermodynamic state (i.e. σ ep (λ) either free of or corrected for sampling artifacts) and includes the following ACRF routine methods: Raman Lidar, Micro Pulse Lidar (MPL) and in-situ aerosol profiles (IAP) with a small aircraft. Profiles of aerosol optical depth τp(λ), from which the profiles of σep(λ)are derived through vertical differentiation, were measured by the NASA Ames Airborne Tracking 14-channel Sunphotometer (AATS-14); these data were used as truth in this evaluation. The ACRF IAP σ ep (550 nm) were lower by 16% (during AIOP) and higher by 10% (during ALIVE) when compared to AATS-14. The ACRF MPL σ ep (523 nm) were higher by 24% (AIOP) and 19%-21% (ALIVE) compared to AATS-14 but the correlation improved significantly during ALIVE. In the AIOP a second MPL operated by NASA showed a smaller positive bias (13%) with respect to AATS-14. The ACRF Raman Lidar σ ep (355 nm) were higher by 54% (AIOP) and higher by 6% (ALIVE) compared to AATS-14. The large bias in AIOP stemmed from a gradual loss of the sensitivity of the Raman Lidar starting about the end of 2001 going unnoticed until after AIOP. A major refurbishment and upgrade of the instrument and improvements to a data-processing algorithm led to the significant improvement and very small bias in ALIVE. Finally we find that during ALIVE the Raman Lidar water vapor densities ρw are higher by 8% when compared to AATS-14, whereas comparisons between AATS-14 and in-situ measured ρw aboard two different aircraft showed small negative biases (0 to -3%).

47 OTHER INSTRUMENTATION↗

Integration of historical map and aerial imagery to characterize long-term land-use change and landscape dynamics: An object-based analysis via Random Forests

Tracking Earth’s past helps us to move from hindsight to foresight in seeking landscape sustainability, a pursuit aided by modern mapping capabilities but hindered by a dearth of historical landscape information. To fill the data gap and exemplify the use of old map for land-use change sciences, we combined a paper-based US civil war map and aerial photos to derive land-use history and landscape dynamics at fine scales for a region near Chancellorsville, VA, USA, from 1867 to 2014. We also tested how advanced algorithms—object-based analysis and random forests (RF)—could aid in data processing. Automatic classification of the 1867 map proved difficult, but its manual digitization could benefit from object-based image segmentation. Classifying digital aerial images was more accurate via the object-based than pixel-based method, but only if the images were segmented appropriately. In the object-based classification, spectral-based features were much more important than shape/geometry features, as ranked by RF. During the 147 years, 32% of the region changed in land type. Settlement and roads increased in extent by 1850% and 691%, respectively, and woodland decreased by 19%. These changes fragmented the landscape, altered the hydrological regime, and affected river morphology. The utility of old maps exemplified here provides an impetus for exploring and leveraging extant old maps or historical records to support land-use and global change research. Our study also connotes the importance of geotagging current data, such as photos and videos, that may serve as a baseline to document future landscape change.

Historical map, object-based, Random Forests, old ↗

19-LW-045 Full Length Final Report. Molecular Mechanisms of Bacterial Pathogenesis: Waging the Arms Race with Superbugs

As the current global pandemic makes abundantly clear, we need a better understanding of infectious disease to safeguard human health, the economy and global security. Modern omics techniques hold the promise of providing a comprehensive understanding of the molecular mechanisms of life, including causes of pathogenesis from infectious disease at the molecular level, but we there is a serious gap in annotation of gene function. For as much as half of the genes and gene products encoded in genomes the molecular and/or cellular function is unknown or only partially understood. Recent innovations in fluorescence microscopy for live cell imaging and genetic engineering make it possible to determine the temporal correlation between molecular events, such as a gene being expressed due to host-pathogen interaction, and cellular events, such as bacterial invasion of immune cells. This is turn allows us to gain new insight as to the molecular and cellular role of individual genes and will enable the discovery and validation of new molecular mechanisms essential for infectious disease. Knowing the molecular mechanisms of disease processes will provide new therapeutic targets or novel countermeasure strategies. We aimed to develop a lattice light sheet fluorescence microscope as a unique resource at LLNL for long time course live cell imaging experiments; to develop the reagents and cell lines needed to monitor molecular events during the course pathogenic bacteria infecting mammalian immune cells; and to demonstrate that we could capture molecular events during an infection. We fully commissioned the LLNL lattice light sheet microscope and conducted initial proof of principle imaging experiments on mammalian immune cells and pathogenic bacteria. It is clear from the experience gained that long time course live cell imaging has tremendous potential to help elucidate molecular mechanisms of host-pathogen interactions and to help annotate gene function, which would establish a basis for new countermeasures. It is also clear that if live cell imaging is to realize its full potential new data processing and analysis tools will need to be developed to facilitate analysis of molecular events within cells; new sample chambers and stages could facilitate studies with a wider range of cell and tissue types; and alternative molecular tagging methods need to be explored to enable more facile engineering of cells labeled with molecular specificity.

59 BASIC BIOLOGICAL SCIENCES↗

Dynamic time-warping correction for shifts in ultrahigh resolving power ion mobility spectrometry and structures for lossless ion manipulations

Detection of arrival time shifts between ion mobility spectrometry (IMS) separations can limit achievable resolving power (Rp), particularly when multiple separations are summed or averaged, as commonly practiced. Such variations are more apparent in higher Rp measurements, and are particularly evident in long path length traveling wave structures for lossless ion manipulations (SLIM) IMS due to their typically much longer separation times. Here we explore the utility of a data processing approaches employing linear alignment (LA) and nonlinear dynamic time warping (DTW) of IMS separations to correct for variations between separations, such as due to pressure fluctuations. For multipass SLIM IMS separations, where narrow mobility range measurements have arrival times that can extend to several seconds, the LA approach effectively corrected for such variations, and significantly improvement Rp for summed separations. However, LA was much less effective for high Rp broad mobility range separations, such as obtained with multilevel SLIM IMS. Changes in IMS arrival times ions were observed to be correlated with small pressure changes, with approximately 0.6% relative arrival time shifts being common, sufficient to result in a loss of Rp for summed separations. Comparison of the approaches showed DTW alignment performed similarly to LA when used over a narrow mobility range, but was significantly better (providing narrower peaks and higher signal intensities) for wide mobility range data. We found the DTW approach increased Rp by as much as 115% for measurements in which 50 IMS separations over 2 seconds were summed, and leading to a large improvement in effective Rp. We conclude that DTW is superior to LA for ultrahigh resolution broad mobility range SLIM IMS separations, correcting for ion arrival time shifts regardless of the cause. Our tool is publicly available for use with universal ion mobility format (.UIMF) and text (.txt) files.

Data alignment, dynamic time warping, ion mobility↗

Application of artificial intelligence methods in the international roughness index prediction of rigid and composite pavements: a systematic review

The International Roughness Index (IRI) is a widely adopted metric for quantifying pavement roughness, directly influencing vehicle safety, ride comfort, and overall roadway performance. In recent years, the use of Machine Learning (ML) models for IRI prediction has gained momentum, with the goal of improving the allocation of maintenance and rehabilitation resources by enabling accurate assessments of pavement conditions. Most prior reviews, however, have concentrated on flexible pavements, leaving a notable gap regarding rigid and composite pavements. To address this gap, the present study conducts a systematic review of Artificial Intelligence (AI) methods applied to IRI prediction for rigid and composite pavements. Literature published between 2004 and 2025 is synthesized to highlight prevailing trends, methodological contributions, and directions for future research. Particular attention is given to the types of models employed, the datasets used for training and validation, and the role of input variables and data-processing strategies. Across the included studies, ensemble learning methods (especially gradient boosting variants such as XGBoost), artificial neural networks, and hybrid architectures frequently achieved high predictive skill, with several models reporting test-set coefficients of determination approaching 0.9–0.96, indicating strong potential for capturing the influence of traffic, pavement structure, and climatic factors. Since these results are obtained from heterogeneous datasets and evaluation protocols, they are interpreted qualitatively rather than as strict cross-study rankings. Analysis of input variables revealed that pavement age and initial IRI were included in 91% (21 of 23) and 78% (18 of 23) of studies, respectively. Climatic variables such as the freezing index appeared in 57% (13 of 23), while traffic-related factors were considered in 65% (15 of 23). The findings underscore the importance of standardized, high-quality datasets, such as those from the Long-Term Pavement Performance (LTPP) program, along with data consistency, model interpretability, computational efficiency, and replicability in enhancing IRI prediction. Future research should focus on incorporating input variable selection techniques to identify the most influential predictors, thereby improving accuracy and robustness. Integrating these approaches with advanced non-linear data-driven models, coupled with robust hyperparameter optimization, holds considerable promise for strengthening the reliability of IRI prediction and supporting resilient pavement management strategies.

42 ENGINEERING↗

ORNL Second Target Station Project: Biological & Environmental Science Workshop

Recent advances in neutron sources and instrumentation have opened up many new opportunities for the application of neutron scattering techniques in the biological and environmental sciences. Neutrons enable studies of the structure and dynamics of biological and environmental samples with a particular sensitivity to light elements, such as hydrogen, which is a key component of biological and environmental samples. Studies using neutrons are complementary to X-rays and have the unique advantage of being non-destructive and highly-penetrating. Oak Ridge National Laboratory’s upcoming Spallation Neutron Source (SNS) Second Target Station (STS) will provide high brightness cold neutron sources that significantly advance the scientific capabilities of neutron scattering instruments. The STS will advance our understanding of biological and environmental processes across spatial and temporal scales. The capabilities will enhance our ability to discover, design, and develop new materials essential for advanced sustainable technologies to address society’s most pressing needs. This report summarizes the discussions and recommendations from a joint workshop held by the STS Project and the Biological and Environmental Systems Science Directorate (BESSD) in June 2022. The purpose of the workshop was to explore science opportunities and capabilities related to biological and environmental systems that could be incorporated into both current and future STS instrument designs, as well as additional instruments at the SNS First Target Station (FTS) and High Flux Isotope Reactor (HFIR). With six breakout sessions, each with two invited plenary speakers from other institutions, the participants discussed a wide range of topics relevant to biological and environmental research. Based on the input from participants, a number of recommendations on instrumentation, sample environments, complementary multi-modal methods, data processing and analysis and sample deuteration are provided in the report. The participants also identified science opportunities that are emerging from the planned instrument capabilities at STS. Selected recommendations and science opportunities are listed in the Executive Summary.

54 ENVIRONMENTAL SCIENCES↗

Use of the ARM Measurement of Spectral Zenith Radiance For Better Understanding Of 3D Cloud-Radiation Processes and Aerosol-Cloud Interaction

Our proposal focuses on cloud-radiation processes in a general 3D cloud situation, with particular emphasis on cloud optical depth and effective particle size. We also focus on zenith radiance measurements, both active and passive. The proposal has three main parts. Part One exploits the "solar-background" mode of ARM lidars to allow them to retrieve cloud optical depth not just for thin clouds but for all clouds. This also enables the study of aerosol cloud interactions with a single instrument. Part Two exploits the large number of new wavelengths offered by ARM's zenith-pointing ShortWave Spectrometer (SWS), especially during CLASIC, to develop better retrievals not only of cloud optical depth but also of cloud particle size. We also propose to take advantage of the SWS's 1 Hz sampling to study the "twilight zone" around clouds where strong aerosol-cloud interactions are taking place. Part Three involves continuing our cloud optical depth and cloud fraction retrieval research with ARM's 2NFOV instrument by, first, analyzing its data from the AMF-COPS/CLOWD deployment, and second, making our algorithms part of ARM's operational data processing.

07 ISOTOPE AND RADIATION SOURCES↗

X-ray chemical imaging for assessing redox microsites within soils and sediments

Redox reactions underlie several biogeochemical processes and are typically spatiotemporally heterogeneous in soils and sediments. However, redox heterogeneity has yet to be incorporated into mainstream conceptualizations and modeling of soil biogeochemistry. Anoxic microsites, a defining feature of soil redox heterogeneity, are non-majority oxygen depleted zones in otherwise oxic environments. Neglecting to account for anoxic microsites can generate major uncertainties in quantitative assessments of greenhouse gas emissions, C sequestration, as well as nutrient and contaminant cycling at the ecosystem to global scales. However, only a few studies have observed/characterized anoxic microsites in undisturbed soils, primarily, because soil is opaque and microsites require µm-cm scale resolution over cm-m scales. Consequently, our current understanding of microsite characteristics does not support model parameterization. To resolve this knowledge gap, we demonstrate through this proof-of-concept study that X-ray fluorescence (XRF) 2D mapping can reliably detect, quantify, and provide basic redox characterization of anoxic microsites using solid phase “forensic” evidence. First, we tested and developed a systematic data processing approach to eliminate false positive redox microsites, i.e., artefacts, detected from synchrotron-based multiple-energy XRF 2D mapping of Fe (as a proxy of redox-sensitive elements) in Fe-“rich” sediment cores with artificially injected microsites. Then, spatial distribution of Fe II and Fe III species from full, natural soil core slices (over cm-m lengths/widths) were mapped at 1–100 µm resolution. These investigations revealed direct evidence of anoxic microsites in predominantly oxic soils such as from an oak savanna and toeslope soil of a mountainous watershed, where anaerobicity would typically not be expected. We also revealed preferential spatial distribution of redox microsites inside aggregates from oak savanna soils. We anticipate that this approach will advance our understanding of soil biogeochemistry and help resolve “anomalous” occurrences of reduced products in nominally oxic soils.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Resource Management for Processing Wide Area Data Streams on Supercomputers

Modern scientific instruments generate enormous amount of data. Typically, the data collected from the instruments are stored in one or more files that are then moved to a distant supercomputer for processing. The final results are sent back to the user. In order to make effective use of the time on expensive instruments, experimenters want to process the data as they are generated. They want to stream the data from instruments' memory directly to a supercomputer's memory for analysis. Since the compute nodes in a supercomputer are not connected directly to the wide area network, the data streams need to be passed through intermediate gateway nodes. As opposed to the best effort file transfers, data streaming applications require resources at a specific time for a specific period. In this paper, we present a system model for enabling data streaming through gateway nodes and an algorithm to efficiently allocate gateway node resources along with compute nodes. We evaluate the algorithm using real-world traces on the Chameleon Cloud. The results show that our system can schedule compute and gateway resources efficiently for streaming analysis.

data streaming↗