SEARCH · Engineering Papers

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2014

FRACTURE MECHANICS APPROACH TO ESTIMATE FATIGUE LIVES OF WELDED LAP-SHEAR SPECIMENS

A full range of stress intensity factor solutions for a kinked crack is developed as a function of weld width and the sheet thickness. When used with the associated main crack solutions (global stress intensity factors) in terms of the applied load and specimen geometry, the fatigue lives can be estimated for the laser-welded lap-shear specimens. The estimations are in good agreement with the experimental data. A classical solution for an infinitesimal kink is also employed in the approach. However, the life predictions tend to overestimate the actual fatigue lives. The traditional life estimations with the structural stress along with the experimental stress-fatigue life data (S-N curve) are also provided. In this case, the estimations only agree with the experimental data under higher load conditions.

36 MATERIALS SCIENCE↗

DOE OSTI2022

Application of sulfur SAD to small crystals with a large asymmetric unit and anomalous substructure

The application of sulfur single-wavelength anomalous dispersion (S-SAD) to determine the crystal structures of macromolecules can be challenging if the asymmetric unit is large, the crystals are small, the size of the anomalously scattering sulfur structure is large and the resolution at which the anomalous signals can be accurately measured is modest. Here, as a study of such a case, approaches to the SAD phasing of orthorhombic Ric-8A crystals are described. The structure of Ric-8A was published with only a brief description of the phasing process [Zeng et al. (2019), Structure , 27 , 1137–1141]. Here, alternative approaches to determining the 40-atom sulfur substructure of the 103 kDa Ric-8A dimer that composes the asymmetric unit are explored. At the data-collection wavelength of 1.77 Å measured at the Frontier micro-focusing Macromolecular Crystallography (FMX) beamline at National Synchrotron Light Source II, the sulfur anomalous signal strength, |Δ ano |/σΔ ano ( d ′′/sig), approaches 1.4 at 3.4 Å resolution. The highly redundant, 11 000 000-reflection data set measured from 18 crystals was segmented into isomorphous clusters using BLEND in the CCP 4 program suite. Data sets within clusters or sets of clusters were scaled and merged using AIMLESS from CCP 4 or, alternatively, the phenix.scale_and_merge tool from the Phenix suite. The latter proved to be the more effective in extracting anomalous signals. The HySS tool in Phenix , SHELXC / D and PRASA as implemented in the CRANK 2 program suite were each employed to determine the sulfur substructure. All of these approaches were effective, although HySS , as a component of the phenix.autosol tool, required data from all crystals to find the positions of the sulfur atoms. Critical contributors in this case study to successful phase determination by SAD included (i) the high-flux FMX beamline, featuring helical-mode data collection and a helium-filled beam path, (ii) as recognized by many authors, a very highly redundant, multiple-crystal data set and (iii) the inclusion within that data set of data from crystals that were scanned over large ω ranges, yielding highly isomorphous and highly redundant intensity measurements.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

MIGHTEE: total intensity radio continuum imaging and the COSMOS/XMM-LSS Early Science fields

ABSTRACT MIGHTEE is a galaxy evolution survey using simultaneous radio continuum, spectropolarimetry, and spectral line observations from the South African MeerKAT telescope. When complete, the survey will image ∼20 deg2 over the COSMOS, E-CDFS, ELAIS-S1, and XMM-Newton Large Scale Structure field (XMM-LSS) extragalactic deep fields with a central frequency of 1284 MHz. These were selected based on the extensive multiwavelength data sets from numerous existing and forthcoming observational campaigns. Here, we describe and validate the data processing strategy for the total intensity continuum aspect of MIGHTEE, using a single deep pointing in COSMOS (1.6 deg2) and a three-pointing mosaic in XMM-LSS (3.5 deg2). The processing includes the correction of direction-dependent effects, and results in thermal noise levels below 2 $\mathrm{\mu }$Jy beam−1 in both fields, limited in the central regions by classical confusion at ∼8 arcsec angular resolution, and meeting the survey specifications. We also produce images at ∼5 arcsec resolution that are ∼3 times shallower. The resulting image products form the basis of the Early Science continuum data release for MIGHTEE. From these images we extract catalogues containing 9896 and 20 274 radio components in COSMOS and XMM-LSS, respectively. We also process a close-packed mosaic of 14 additional pointings in COSMOS and use these in conjunction with the Early Science pointing to investigate methods for primary beam correction of broad-band radio images, an analysis that is of relevance to all full-band MeerKAT continuum observations, and wide-field interferometric imaging in general. A public release of the MIGHTEE Early Science continuum data products accompanies this article.

Heywood, I. (ORCID:0000000168645057)↗

DOE OSTI2021

High-Accuracy Module Emulators from Physically-Constrained AI Algorithms

Focal Area(s): How do we use AI tools to integrate observations, simulated data and physical and chemical fundamentals (Focal Area 3) into model components (Focal Area 2) that have high accuracy and stability and low computational burden to improve Earth System Predictability? Science Challenge: Earth system modeling of the hydrological cycle involves compute-intensive modules representing complex chemical and physical process. Recently, AI tools that are far less compute intensive have been developed that emulate these modules, but many of these efforts are not yet sufficiently accurate or even stable. We know a lot about the physics and chemistry of earth system processes. The Science Challenge is developing AI tools that not only incorporate observations and simulated data, but also incorporate the physics and chemistry of the process, while still maintaining the compute efficiency.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2014

FIFE-Jobsub: a grid submission system for intensity frontier experiments at Fermilab

The Fermilab Intensity Frontier Experiments use an integrated submission system known as FIFE-jobsub, part of the FIFE (Fabric for Frontier Experiments) initiative, to submit batch jobs to the Open Science Grid. FIFE-jobsub eases the burden on experimenters by integrating data transfer and site selection details in an easy to use and well-documented format. FIFE-jobsub automates tedious details of maintaining grid proxies for the lifetime of the grid job. Data transfer is handled using the Intensity Frontier Data Handling Client (IFDHC) [1] tool suite, which facilitates selecting the appropriate data transfer method from many possibilities while protecting shared resources from overload. Chaining of job dependencies into Directed Acyclic Graphs (Condor DAGS) is well supported and made easier through the use of input flags and parameters.

Box, Dennis↗

DOE OSTI2026

New approaches to Bayesian uncertainty quantification for Nuclear Science (Final Technical Report)

Inverse problems play a central role in experimentation and theory/data comparisons for many areas of modern Nuclear Physics (NP) and High-Energy Physics (HEP). Bayes’s Theorem is a powerful tool for solving Inverse Problems, providing conceptually transparent and unbiased constraints on theoretical parameters and their uncertainties (“Bayesian Inference”) and enabling the quantification of agreement or tension between models and data. However, analyses based on Bayesian Inference are often challenging for NP and HEP applications, either because of the large number of parameters in the problem, the high computational cost, or both. We propose a multi-institutional collaboration to develop and deploy novel Bayesian analysis tools that advance the scientific scope of a broad range of current and future NP experiments. This project brings together NP domain scientists working on several high-profile NP projects for which new, high-performance Bayesian Uncertainty Quantification (“Bayesian UQ”) methods are essential to carry out the science, and data scientists who are developing state-of-the-art methods applicable to these problems. The NP projects in this proposal comprise measurements of the mass and fundamental nature of the neutrino; study of the Quark-Gluon Plasma that filled the early universe; and mapping of natural and anthropogenic radiation environments. While these NP projects have very different scientific goals, with datasets and analysis approaches that differ significantly, they share common requirements for improving computationally intensive Bayesian analyses using advanced Machine Learning algorithms and will benefit strongly from a coherent effort to develop general solutions. This proposal brings together these projects and forefront ML-based data science algorithms to develop such general solutions. The methods developed in this project will also be more widely applicable, thereby advancing science in the larger Nuclear Physics portfolio.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2015

TRIO: Burst Buffer Based I/O Orchestration, In: 2015 IEEE International Conference on Cluster Computing

The growing computing power on leadership HPC systems is often accompanied by ever-escalating failure rates. Checkpointing is a common defensive mechanism used by scientific applications for failure recovery. However, directly writing the large and bursty checkpointing dataset to parallel file systems can incur significant I/O contention on storage servers. Such contention in turn degrades bandwidth utilization of storage servers and prolongs the average job I/O time of concurrent applications. Recently burst buffers have been proposed as an intermediate layer to absorb the bursty I/O traffic from compute nodes to storage backend. But an I/O orchestration mechanism is still desirable to efficiently move checkpointing data from burst buffers to storage backend. In this paper, we propose a burst buffer based I/O orchestration framework, named TRIO, to intercept and reshape the bursty writes for better sequential write traffic to storage servers. Meanwhile, TRIO coordinates the flushing orders among concurrent burst buffers to alleviate the contention on storage server. Our experimental results demonstrated that TRIO could efficiently utilize storage bandwidth and reduce the average job I/O time by 37% on average for data-intensive applications in typical checkpointing scenarios.

Computer Science↗

DOE OSTI2012

The Ongoing Impact of the U.S. Fast Reactor Integral Experiments Program

The creation of a large database of integral fast reactor physics experiments advanced nuclear science and technology in ways that were unachievable by less capital intensive and operationally challenging approaches. They enabled the compilation of integral physics benchmark data, validated (or not) analytical methods, and provided assurance of future rector designs The integral experiments performed at Argonne National Laboratory (ANL) represent decades of research performed to support fast reactor design and our understanding of neutronics behavior and reactor physics measurements. Experiments began in 1955 with the Zero Power Reactor No. 3 (ZPR-3) and terminated with the Zero Power Physics Reactor (ZPPR, originally the Zero Power Plutonium Reactor) in 1990 at the former ANL-West site in Idaho, which is now part of the Idaho National Laboratory (INL). Two additional critical assemblies, ZPR-6 and ZPR-9, operated at the ANL-East site in Illinois. A total of 128 fast reactor assemblies were constructed with these facilities [1]. The infrastructure and measurement capabilities are too expensive to be replicated in the modern era, making the integral database invaluable as the world pushes ahead with development of liquid metal cooled reactors.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2025

Ultimate brightness of a medium-energy synchrotron light source at operational beam intensity

Synchrotron light sources are key instruments of modern science, providing unique opportunities for groundbreaking studies in diverse scientific disciplines and driving innovation in numerous scientific and technological fields. Fourth-generation light sources provide unprecedented capabilities in imaging, spectroscopy and diffraction techniques. Ultimate brightness is the key to advancing to a smaller scale, faster response, and higher data measurement and processing rate. The brightness is primarily determined by the electron beam emittance and energy spread at operational intensity. A common feature of fourth-generation synchrotrons is the short length of the electron bunches combined with a very small transverse beam size. Consequently, the high particle density leads to strong collective effects that significantly increase the emittance and limit the achievable brightness at operational beam intensity. In this article, we summarize our studies of the emittance and brightness scaled with the beam energy and intensity, taking into account the effects of intrabeam scattering, beam-impedance interaction and bunch lengthening provided by higher-harmonic RF systems to identify optimal combinations of machine and beam parameters.

36 MATERIALS SCIENCE↗

DOE OSTI2015

A new development on measurement and control software of SANS BATAN spectrometer (SMARTer) in Serpong, Indonesia

In 2005, the main computer for data acquisition and control system of Small-angle Neutron Scattering (SANS) BATAN Spectrometer (SMARTer) was replaced since it halted to operate the spectrometer. According to this replacement, the new software for data acquisition and control system has been developed in-house. Visual Basic programming language is used in developing the software. In the last two years, many developments have been made both in the hardware and also the software to conduct the experiment is more effective and efficient. Lately, the previous motor controller card (ISA Card) was replaced with the programmable motor controller card (PCI Card) for driving one motor of position sensitive detector (PSD), eight motors of four collimators, and six motors of six pinhole discs. This new control system software makes all motors can be moved simultaneously, then it reduces significantly the consuming time of setting up the instrument before running the experiment. Along with that development, the new data acquisition software under MS Windows operating system is also developed to drive a beam stopper in X-Y directions as well as to read the equipment status such as position of the collimators and PSD, to acquire neutron counts on monitor and PSD detectors, and also to manage 12 samples position automatically. A timer object which is set in one second to read the equipment status via serial port of the computer (RS232C), and general purpose interface board (GPIB) for reading the total counts of each pixel of the PSD from histogram memory was used in this new software. The experiment result displayed in real time on the main window, and the data is saved in the special format for further data reduction and analysis. The new software has been implemented and performed for experiment using a preset count or preset time mode for absolute scattering intensity method.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2026

RTN-124: Photometric Redshifts for the Vera C. Rubin Observatory Data Preview

We present the photometric redshifts (photo-z) inferred using algorithms implemented in the Redshift Assessment Infrastructure Layers (RAIL) for the NSF-DOE Vera C. Rubin Observatory Data Preview 2 (DP2). We produce a compilation of reference redshift catalog using spectroscopic, grism and many band photometric redshift dataset hosted on the LIneA Photo-z Server. We curate training and testing set for assessing the scientific and technical performance of Rubin photo-z. The algorithm applied to the object catalog are FlexZBoost, BPZ, kNN, GPz, DNF and TPz; with a combination of 6-band and 4-band photo-z depending on availability of u and y photometry. The redshift point estimates and uncertainty estimation in tabular format through the Large Survey DataBase (LSDB).

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

ARM Aerosol Measurement Science Group 2019 Strategic Planning Workshop Report

This report summarizes the results of a U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility workshop held in November 2019 to advance a science-based strategy for ARM’s aerosol measurement program. This was the second such workshop since the Aerosol Measurement Science Group (AMSG) was chartered in 2015 to enhance coordination of ARM observations of aerosols and atmospheric trace gases with the needs of ARM users. The results presented here reflect the AMSG’s focus in recent years on science-based strategies that will contribute to the increased use of ARM data to fulfill its mission of improving process representations and predictability in climate models. Sessions held during the workshop range from interfacing with models through aerosol sampling strategies to calibration protocols and data products. The AMSG workshops have been designed to recommend actions that will enable ARM to evolve and continue to meet its mission. To that end, the AMSG will develop an actionable plan from the recommendations outlined here. Some are well defined and can reasonably be accomplished in the short term. Others are less definite or of a larger scope that calls for a longer-term implementation. Further discussion will be required to develop and prioritize actionable items related to such areas. Task teams comprising the appropriate expertise and perspective from the AMSG and other members of the community will be formed to achieve this outcome. Some particular topics are recognized as high priority, so plans are underway to develop task teams and to hold follow-on discussions to address them. Four areas currently being considered for short, focused discussion are 1) aerosol measurements on the North Slope of Alaska, 2) improving data usability for modeling, 3) strategies for advancing remote sensing, vertical profiling, and distributed measurements of aerosols, and 4) aerosol sampling strategies at existing ARM sites to provide intensive modes of operation to promote data usage for process and modeling studies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Seismology in the Cloud: A New Streaming Workflow

Data-intensive research in seismology is experiencing a recent boom, driven in part by large volumes of available data and advances in the growing field of data science. However, there are significant barriers to processing large data volumes, such as long retrieval times from data repositories, complex data management, and limited computational resources. New tools and platforms have reduced the barriers to entry for scientific cluster computing, including the maturation of the commercial cloud as an accessible instrument for research. Here, we build a customized research cluster in the cloud to test a new workflow for large-scale seismic analysis, in which data are processed as a stream (retrieved on-the-fly and acted upon without storing), with data from the Incorporated Research Institutions for Seismology Data Management Center. We use this workflow to deploy a spectral peak detection algorithm over 5.6 TB of compressed continuous seismic data from 2074 stations of the USArray Transportable Array EarthScope network. Using a 50-node cluster in the cloud, we completed the noise survey in 80 hr, with an average data throughput of 1.7 GB per minute. By varying cluster sizes, we find the scaling of our analysis to be sublinear, due to a combination of algorithmic limitations and data center response times. The cloud-based streaming workflow represents an order-of-magnitude increase in acquisition and processing speed compared to a traditional download-store-process workflow, and offers the additional benefits of employing a flexible, accessible, and widely used computing architecture. It is limited, however, due to its reliance on Internet transfer speeds and data center service capacity, and may not work well for repeated analyses or those for which even higher data throughputs are needed. These research applications will require a new class of cloud-native approaches in which both data and analysis are in the cloud.

58 GEOSCIENCES↗

DOE OSTI2022

Examining the Ice-Nucleating Particles from the Eastern North Atlantic (ExINP-ENA) (Field Campaign Report)

The Examining the Ice-Nucleating Particles from the Eastern North Atlantic (ExINP-ENA) field campaign was conducted at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s Eastern North Atlantic (ENA) observatory on Graciosa Island, Azores (39.0916° N, 28.0257° W). The ExINP-ENA campaign began on October 1, 2020, and collected data until March 28, 2021, for a total of 179 days of data generated, with a 45-day intensive operational period (IOP) from October 10 to November 24. This campaign was funded by the DOE Office of Science Early Career Research Program through grant DE-SC001879. This grant contains funding for three field campaigns. The previous field campaign at the Southern Great Plains (SGP) site in Oklahoma, ExINP-SGP, was completed in 2020 (36.6073° N, 97.4876° W), and the upcoming field campaign at the North Slope of Alaska (NSA), ExINP-NSA, will take place from October 2021 at the National Oceanic and Atmospheric Administration (NOAA) Barrow Atmospheric Baseline Observatory (71.3230° N, 156.6114° W).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

ExaFEL: extreme-scale real-time data processing for X-ray free electron laser science

ExaFEL is an HPC-capable X-ray Free Electron Laser (XFEL) data analysis software suite for both Serial Femtosecond Crystallography (SFX) and Single Particle Imaging (SPI) developed in collaboration with the Linac Coherent Lightsource (LCLS), Lawrence Berkeley National Laboratory (LBNL) and Los Alamos National Laboratory. ExaFEL supports real-time data analysis via a cross-facility workflow spanning LCLS and HPC centers such as NERSC and OLCF. Our work therefore constitutes initial path-finding for the US Department of Energy's (DOE) Integrated Research Infrastructure (IRI) program. We present the ExaFEL team's 7 years of experience in developing real-time XFEL data analysis software for the DOE's exascale supercomputers. We present our experiences and lessons learned with the Perlmutter and Frontier supercomputers. Furthermore we outline essential data center services (and the implications for institutional policy) required for real-time data analysis. Finally we summarize our software and performance engineering approaches and our experiences with NERSC's Perlmutter and OLCF's Frontier systems. This work is intended to be a practical blueprint for similar efforts in integrating exascale compute resources into other cross-facility workflows.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

ARM Aerosol Measurement Science Group 2019 Strategic Planning Workshop Report

This report summarizes the results of a U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility workshop held in November 2019 to advance a science-based strategy for ARM’s aerosol measurement program. This was the second such workshop since the Aerosol Measurement Science Group (AMSG) was chartered in 2015 to enhance coordination of ARM observations of aerosols and atmospheric trace gases with the needs of ARM users. The results presented here reflect the AMSG’s focus in recent years on science-based strategies that will contribute to the increased use of ARM data to fulfill its mission of improving process representations and predictability in climate models. Sessions held during the workshop range from interfacing with models through aerosol sampling strategies to calibration protocols and data products. The strategies set forth here were also developed to be directly relevant to ARM’s updated Decadal Vision. The AMSG workshops have been designed to recommend actions that will enable ARM to evolve and continue to meet its mission. To that end, the AMSG will develop an actionable plan from the recommendations outlined here. Some are well defined and can reasonably be accomplished in the short term. Others are less definite or of a larger scope that calls for a longer-term implementation. Further discussion will be required to develop and prioritize actionable items related to such areas. Task teams comprising the appropriate expertise and perspective from the AMSG and other members of the community will be formed to achieve this outcome. Some particular topics are recognized as high priority, so plans are underway to develop task teams and to hold follow-on discussions to address them. Four areas currently being considered for short, focused discussion are 1) aerosol measurements on the North Slope of Alaska, 2) improving data usability for modeling, 3) strategies for advancing remote sensing, vertical profiling, and distributed measurements of aerosols, and 4) aerosol sampling strategies at existing ARM sites to provide intensive modes of operation to promote data usage for process and modeling studies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2015

Comparison of algorithms for determination of rotation measure and Faraday structure. I. 1100–1400 MHz

Faraday rotation measures (RMs) and more general Faraday structures are key parameters for studying cosmic magnetism and are also sensitive probes of faint ionized thermal gas. A definition of which derived quantities are required for various scientific studies is needed, as well as addressing the challenges in determining Faraday structures. A wide variety of algorithms has been proposed to reconstruct these structures. In preparation for the Polarization Sky Survey of the Universe's Magnetism (POSSUM) to be conducted with the Australian Square Kilometre Array Pathfinder and the ongoing Galactic Arecibo L-band Feeds Array Continuum Transit Survey (GALFACTS), we run a Faraday structure determination data challenge to benchmark the currently available algorithms, including Faraday synthesis (previously called RM synthesis in the literature), wavelet, compressive sampling, and QU-fitting. The input models include sources with one Faraday thin component, two Faraday thin components, and one Faraday thick component. The frequency set is similar to POSSUM/GALFACTS with a 300 MHz bandwidth from 1.1 to 1.4 GHz. We define three figures of merit motivated by the underlying science: (1) an average RM weighted by polarized intensity, RM{sub wtd}, (2) the separation Δϕ of two Faraday components, and (3) the reduced chi-squared χ{sub r}{sup 2}. Based on the current test data with a signal-to-noise ratio of about 32, we find the following. (1) When only one Faraday thin component is present, most methods perform as expected, with occasional failures where two components are incorrectly found. (2) For two Faraday thin components, QU-fitting routines perform the best, with errors close to the theoretical ones for RM{sub wtd} but with significantly higher errors for Δϕ. All other methods, including standard Faraday synthesis, frequently identify only one component when Δϕ is below or near the width of the Faraday point-spread function. (3) No methods as currently implemented work well for Faraday thick components due to the narrow bandwidth. (4) There exist combinations of two Faraday components that produce a large range of acceptable fits and hence large uncertainties in the derived single RMs; in these cases, different RMs lead to the same Q, U behavior, so no method can recover a unique input model. Further exploration of all these issues is required before upcoming surveys will be able to provide reliable results on Faraday structures.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2011

Accelerating and democratizing science through cloud-based services.

Many businesses today save time and money, and increase their agility, by outsourcing mundane IT tasks to cloud providers. The author argues that similar methods can be used to overcome the complexities inherent in increasingly data-intensive, computational, and collaborative scientific research. He describes Globus Online, a system that he and his colleagues are developing to realize this vision. he scientific community today has unprecedented opportunities to effect transformational change in how individuals and teams engage in discovery. The driving force is a set of interrelated new capabilities that, when harnessed, can enable dramatic acceleration in the discovery process: greater availability of massive data, exponentially faster computers, ultra-high-speed networks, and deep interdisciplinary collaboration. The opportunity - and challenge - is to make these capabilities accessible not just to a few 'big science' projects but to every researcher at every level. Here, I argue that the key to seizing this opportunity is embracing software delivery methods that haven't been widely adopted in research, notably software as a service (SaaS) - a technology that forms an important part of what people refer to as the cloud. I also describe projects in the Computation Institute at the University of Chicago and Argonne National Laboratory that aim to realize this vision, focusing initially on data movement and management.

99 GENERAL AND MISCELLANEOUS↗