Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

PSTN-056: Survey Cadence Optimization Committee's Phase 3 Recommendations

We present the final planned comprehensive recommendation for Rubin Observatory the Legacy Survey of Space and Time (LSST) survey strategy ahead of the start of LSST. This recommendation is the product of a many-years-long iterative process where community recommendations to maximize the scientific impact of LSST across domains of astrophysics were reviewed, synthesized, aggregated, and merged to define the overall plan for 10 years of LSST observations. The current recommendation builds on Phase 1 (PSTN-053) and Phase 2 recommendations (PSTN-055) and, together, they define a 10-year plan for observing. Here we answer questions left open in PSTN-055, refine additional survey details, and describe the scope of future activities of the SCOC.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Petascale Application of a Coupled CPU-GPU Algorithm for Simulation and Analysis of Multiphase Flow Solutions in Porous Medium Systems, In: 2014 IEEE 28th International Parallel and Distributed Processing Symposium

Large-scale simulation can provide a wide range of information needed to develop and validate theoretical models for multiphase flow in porous medium systems. In this paper, we consider a coupled solution in which a multiphase flow simulator is coupled to an analysis approach used to extract the interfacial geometries as the flow evolves. This has been implemented using MPI to target heterogeneous nodes equipped with GPUs. The GPUs evolve the multiphase flow solution using the lattice Boltzmann method while the CPUs compute up scaled measures of the morphology and topology of the phase distributions and their rate of evolution. Our approach is demonstrated to scale to 4,096 GPUs and 65,536 CPU cores to achieve a maximum performance of 244,754 million-lattice-node updates per second (MLUPS) in double precision execution on Titan. In turn, this approach increases the size of systems that can be considered by an order of magnitude compared with previous work and enables detailed in situ tracking of averaged flow quantities at temporal resolutions that were previously impossible. Furthermore, it virtually eliminates the need for post-processing and intensive I/O and mitigates the potential loss of data associated with node failures.

Computer Science↗
DOE OSTI2015

Applying the cold plasma dispersion relation to whistler mode chorus waves: EMFISIS wave measurements from the Van Allen Probes

Most theoretical wave models require the power in the wave magnetic field in order to determine the effect of chorus waves on radiation belt electrons. However, researchers typically use the cold plasma dispersion relation to approximate the magnetic wave power when only electric field data are available. In this study, the validity of using the cold plasma dispersion relation in this context is tested using Electric and Magnetic Field Instrument Suite and Integrated Science (EMFISIS) observations of both the electric and magnetic spectral intensities in the chorus wave band (0.1–0.9 f ce ). Results from this study indicate that the calculated wave intensity is least accurate during periods of enhanced wave activity. For observed wave intensities >10⁻³ nT², using the cold plasma dispersion relation results in an underestimate of the wave intensity by a factor of 2 or greater 56% of the time over the full chorus wave band, 60% of the time for lower band chorus, and 59% of the time for upper band chorus. Hence, during active periods, empirical chorus wave models that are reliant on the cold plasma dispersion relation will underestimate chorus wave intensities to a significant degree, thus causing questionable calculation of wave-particle resonance effects on MeV electrons.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗
DOE OSTI2019

Nucleosynthesis for Science and Security: Preparing for a Nuclear and Chemical Sciences Program at FRIB

Nuclear reactions are vital to nuclear science and its many applications: they are the mechanism for forging elements in the cosmos, the source of energy for both stars and nuclear weapons, the principal probes used to study nuclear properties, and the primary diagnostic signatures for stockpile stewardship and nuclear forensics. Yet, most reaction experiments have been confined to the small fraction of all nuclei that are stable, and a theoretical foundation for reactions with a true predictive capability is lacking. The Facility for Rare Isotope Beams (FRIB), the flagship U.S. facility in low-energy nuclear science, will offer the opportunity to rectify the long-standing gap in understanding reactions on radioactive nuclei. The work performed in this LDRD project brought together the experimental nuclear physics, radiochemistry, nuclear theory, and high-performance computing expertise of the Nuclear and Chemical Sciences Division to develop new techniques that will be needed to exploit FRIB beams to better understand nuclear reactions. Novel isotope-harvesting techniques were developed to demonstrate that samples could be collected at the National Superconducting Cyclotron Laboratory (NSCL) at Michigan State University (the facility which FRIB builds upon) for direct measurements of long-lived radioisotopes. For isotopes too short lived for direct measurements, indirect approaches were developed that would ultimately be used with high-intensity FRIB radioactive beams. Finally, to better interpret experimental results and reliably extend predictions beyond the available data, a foundation was established for a fully microscopic and unified description of the structure, interactions, and dynamics of two reacting nuclei that moves beyond empirical models. This work has positioned the team for a leadership role at FRIB, enabling LLNL to maintain a world-class nuclear science program and to compete for future talent and funding, both of which are vital for continuing support of the laboratory’s stockpile stewardship mission.

42 ENGINEERING↗
DOE OSTI2025

RTN-095: The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first release of data from the NSF-DOE Vera C. Rubin Observatory, consisting of raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and other derived data products. DP1 is based on 1792 science-grade optical/near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera, LSSTComCam, on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile during the first on-sky commissioning campaign in late 2024. DP1 covers a total of ~15 sq. deg. over seven roughly equally-sized non-contiguous fields, each independently observed in six broad photometric bands, ugrizy, spanning a range of stellar densities and latitudes and overlapping with external reference datasets. The median image quality across all bands, measured by the FWHM of the point-spread function, is approximately 1.13 arcseconds, with the sharpest images reaching about 0.65 arcseconds. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and available to Rubin data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations across all four LSST themes, providing a valuable opportunity to engage with Rubin data ahead of the start of full operations in late 2025.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Mathematical modelling the pathway of genomic instability in lung cancer

Genomic instability plays a significant role in lung cancer. Although substantial research has been conducted using both clinical and theoretical studies, it is still a hotly debated issue to whether genomic instability is necessary or whether genomic instability precedes oncogenes activation and tumor suppressor genes inactivation for lung cancer. In response to this issue, we come up with a mathematical model incorporating effects of genomic instability to investigate the genomic instability pathway of human lung cancer. The presented model are applied to match the incidence rate data of lung cancer from the Life Span Study cohort of the atomic bomb survivors in Nagasaki and Hiroshima and the Surveillance Epidemiology and End Results registry in the United States. Model results suggest that genomic instability is necessary in the tumorigenesis of lung cancer, and genomic instability has no significant impact on the net proliferation rate of cells by statistical criteria. By comparing the results of the LSS data to those of the SEER data, we conclude that the genomic instability pathway exhibits a sensitivity to radiation exposure, more intensive in male patients.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

CROCUS Urban Canyons - Space Science and Engineering Center (SPARC) Doppler lidar data

This is the netCDF format output from the Halo Photonics Streamline XR Doppler lidar that was deployed next to the Space Science and Engineering Center (SPARC) trailer at the University of Illnois-Chicago greenhouse parking lot during CROCUS Urban Canyons. The purpose of collecting this dataset is to provide vertical and horizontal wind profiles for studying the characteristics of turbulence over the urban canyon of Chicago. This data contains the radial velocity, intensity, and backscatter from the vertical profile, range height indicator, and sector scans that were performed over both Intensive Operating Period 1 and 2 of CROCUS Urban Canyons. There are four different types of files: * The Range Height Indicator (RHI) files contain scans that are along a constant azimuth, spanning the entire hemisphere of elevation values above the surface. * The Velocity Azimuth Display (VAD) files contain the raw radial velocity data from the 6-beam, 60 degree scans. * The User1 files contain stacked Plan Position Indicator scans over a 45 degree quadrant over downtown Chicago. * The Stare files contain vertically pointing scans. These are standard netCDF files that can be opened using xarray. The VAD scans can be processed from their raw radial velocities to horizontal wind speeds with the Atmospheric data Community Toolkit (https://arm-doe.github.io/ACT/).

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC WINDS↗
DOE OSTI2011

A Statistical Selection Strategy for Normalization Procedures in LC-MS Proteomics Experiments through Dataset Dependent Ranking of Normalization Scaling Factors

Quantification of LC-MS peak intensities assigned during peptide identification in a typical comparative proteomics experiment will deviate from run-to-run of the instrument due to both technical and biological variation. Thus, normalization of peak intensities across a LC-MS proteomics dataset is a fundamental step in pre-processing. However, the downstream analysis of LC-MS proteomics data can be dramatically affected by the normalization method selected . Current normalization procedures for LC-MS proteomics data are presented in the context of normalization values derived from subsets of the full collection of identified peptides. The distribution of these normalization values is unknown a priori. If they are not independent from the biological factors associated with the experiment the normalization process can introduce bias into the data, which will affect downstream statistical biomarker discovery. We present a novel approach to evaluate normalization strategies, where a normalization strategy includes the peptide selection component associated with the derivation of normalization values. Our approach evaluates the effect of normalization on the between-group variance structure in order to identify candidate normalization strategies that improve the structure of the data without introducing bias into the normalized peak intensities.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Pulsed laser generation of ultrasound in a metal plate between the melting and ablation thresholds

The generation of ultrasound in a metal plate exposed to nanosecond pulsed laser heating, sufficient to cause melting but not ablation, is treated. Consideration is given to the spatial and temporal profiles of the laser pulse, penetration of the laser beam into the sample, the evolution of the melt pool, and thermal conduction in the melt and surrounding solid. The excitation of the ultrasound takes place over a few nanoseconds, and occurs predominantly within the thermal diffusion length of a micron or so beneath the surface. Because of this, the output of the thermal simulations can be represented as axially symmetric transient radial and normal surface force distributions. The epicentral displacement response at the opposite surface to these forces is obtained by two methods, the one based on the elastodynamic Green’s functions for plate geometry determined by the Cagniard generalized ray method, and the other using a finite element numerical method. The two approaches are in very close agreement. Numerical simulations are reported of the epicentral displacement response of a 3.12mm thick tungsten plate irradiated with a 4 ns pulsed laser beam with Gaussian spatial profile, at intensities below and above the melt threshold. Comparison is made between results obtained using available temperature dependent thermophysical data, and room temperature materials constants except near the melting point.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Flat-histogram extrapolation as a useful tool in the age of big data

In this work, we review recent work by the authors to revisit the concept of extrapolating thermodynamic properties of classical systems using statistical mechanical principles. Specifically, we discuss how the combination of these principles with biased sampling techniques enables the prediction of free energy landscapes and other detailed information, such as structural properties, of the system in question. Remarkably accurate estimates of physical properties across a broad range of conditions have been achieved using this approach, greatly reducing the number of simulations needed to explore a given system's behaviour. While approximate, these extrapolations significantly amplify the amount of reasonably accurate information that can be extracted from simulations enabling a small set of them to feed data-intensive regression algorithms such as neural networks. Thus, this extrapolation methodology represents a useful tool for performing tasks such as high-throughput screening of physical properties, optimising force field parameters, exploring equilibrium phase behaviour, and enabling theory-guided data science for these systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Predictions for microlensing planetary events from core accretion theory

We conduct the first microlensing simulation in the context of a planet formation model. The planet population is taken from the Ida and Lin core accretion model for 0.3 M {sub ☉} stars. With 6690 microlensing events, we find that for a simplified Korea Microlensing Telescopes Network (KMTNet), the fraction of planetary events is 2.9%, out of which 5.5% show multiple-planet signatures. The numbers of super-Earths, super-Neptunes, and super-Jupiters detected are expected to be almost equal. Our simulation shows that high-magnification events and massive planets are favored by planet detections, which is consistent with previous expectation. However, we notice that extremely high-magnification events are less sensitive to planets, which is possibly because the 10 minute sampling of KMTNet is not intensive enough to capture the subtle anomalies that occur near the peak. This suggests that while KMTNet observations can be systematically analyzed without reference to any follow-up data, follow-up observations will be essential in extracting the full science potential of very high magnification events. The uniformly high-cadence observations expected for KMTNet also result in ∼55% of all detected planets not being caustic crossing, and more low-mass planets even down to Mars mass being detected via planetary caustics. We also find that the distributions of orbital inclinations and planet mass ratios in multiple-planet events agree with the intrinsic distributions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Atmospheric Ion Composition, SGP, April-May 2023

These files contain select ion count rates measured by an atmospheric pressure interface time-of-flight mass spectrometer (APi-ToF) at the Atmospheric Radiation Measurement Southern Great Plains site from April 28, 2023 to May 31, 2023. Files are in ICARTT format. The APi-ToF measures the chemical composition of naturally charged ions using mass spectrometry. Due to the nature of the measurements, time-series data are non-quantitative. This dataset contains time-series information for the ions that are typically the most intense ions observed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

COURAGE S7 TBS AIRBORNE SONIC WIND AND TURBULENCE DATA

These data were collected with airborne wind instrumentation booms onboard the TBS at CoURAGE S7 during February 2025. The data include 60 Hz wind speed, component wind speed, wind direction, TKE, TI, and altitude measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

BNF M1 TBS AIRBORNE SONIC WIND AND TURBULENCE DATA

These data were collected with airborne wind instrumentation booms onboard the TBS at BNF M1. The data include 60 Hz wind speed, component wind speed, wind direction, TKE, TI, and altitude measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Raw Lidar and Camera Data Synchronized with Precipitation and Present Weather Data

As part of the sensor characterization task of the SMART 2.0 project, this dataset includes raw data from three spinning lidars ([Ouster OS2-128](https://ouster.com/products/scanning-lidar/os2-sensor/), [Velodyne Puck (VLP-16)](https://velodynelidar.com/products/puck/), and [Velodyne Ultra Puck (VLP-32)](https://velodynelidar.com/products/ultra-puck/)), one camera ([Mako G-319](https://www.alliedvision.com/en/camera-selector/detail/mako/g-319/)), and one present weather sensor ([Vaisala FD-70](https://www.vaisala.com/en/products/weather-environmental-sensors/forward-scatter-fd70)). All data were synchronized, with the log start time indicated in the file name (HHMMSS). The data can be filtered by date, log time (HHMMSS), sensor, frame ID, and weather classification. These data were gathered statically at the Argonne Testbed for Multiscale Observational Science (ATMOS). Two target stop signs were placed in view of the sensors to contribute a target for comparing sensor data under different conditions. The weather data for each day are stored in netCDF “.nc” files. The lidar data contain the X, Y, Z, intensity, reflectivity, and ring from Ouster OS2-128 rev6, Velodyne VLP-16, and Velodyne VLP-32 lidars. ![raw lidar image](LiDAR_pointcloud_ATMOS.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2012

Raman spectroscopy of glasses in the As-Te system

For the first time, the Raman spectra of As{sub x}Te{sub 1-x} glasses, 0.2{<=}x{<=}0.6, have been measured over the entire glass-forming range. The spectra exhibit three broad spectral features attributed to vibrations of structural units having Te-Te, As-Te and As-As bonds. The observed chemical disorder in the glasses is discussed on the basis of partial bond fractions derived from the integrated intensity of the Raman modes. The underlying structural model suggests a dissociation of AsTe- or As{sub 2}Te{sub 3}-related units in the glass melt. The spectra of glasses quenched from different temperatures, as well as those of the annealed vitreous alloys, are consistent with predictions of the model. - Graphical abstract: Raman spectra of the As{sub x}Te{sub 1-x} glasses (0.2{<=}x{<=}0.4 and 0.4{<=}x{<=}0.6). Fractional concentrations of Te-Te, As-Te and As-As bonds in the As{sub x}Te{sub 1-x} glasses calculated using experimental Raman data. The solid lines represent predictions of the dissociation model assuming that the main chemically ordered structural units are related to AsTe. Highlights: Black-Right-Pointing-Pointer For the first time, the Raman spectra of As{sub x}Te{sub 1-x} glasses, 0.2{<=}x{<=}0.6, were measured. Black-Right-Pointing-Pointer The partial bond fractions were derived from the integrated intensity of the Raman modes. Black-Right-Pointing-Pointer An empirical quantitative approach to the Raman data was proposed for the reaction modeling.

36 MATERIALS SCIENCE↗