Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2010

Science and Technology Review January/February 2011

This month's issue has the following articles: (1) World's Most Intense X-Ray Laser Focuses on Livermore Science - Commentary by William H. Goldstein; (2) Groundbreaking Science with the World's Brightest X Rays - Experiments with x rays of unparalleled brightness and extremely short duration aim to reveal new information about atoms and molecules in motion; (3) From Data to Discovery - Ongoing control system enhancements at the National Ignition Facility bolster the understanding of experimental data and keep the system performing at its peak; (4) The Sun in All Its Splendor - Onboard the Solar Dynamics Observatory, Livermore-developed multilayer mirrors are enabling unprecedented full-disk, high-resolution images of the Sun; and (5) Drilling Deep into Plant Veins - A novel combination of imaging techniques is being used to understand the three-dimensional architecture of plant cell walls.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2012

Normalization and missing value imputation for label-free LC-MS analysis

Shotgun proteomic data are affected by a variety of known and unknown systematic biases as well as high proportions of missing values. Typically, normalization is performed in an attempt to remove systematic biases from the data before statistical inference, sometimes followed by missing value imputation to obtain a complete matrix of intensities. Here we discuss several approaches to normalization and dealing with missing values, some initially developed for microarray data and some developed specifically for mass spectrometry-based data.

Environmental Molecular Sciences Laboratory↗
DOE OSTI2015

Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) Science Plan

Cumulus convection is an important component in the atmospheric radiation budget and hydrologic cycle over the Southern Great Plains and over many regions of the world, particularly during the summertime growing season when intense turbulence induced by surface radiation couples the land surface to clouds. Current convective cloud parameterizations contain uncertainties resulting in part from insufficient coincident data that couples cloud macrophysical and microphysical properties to inhomogeneities in boundary layer and aerosol properties. The Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) campaign is designed to provide a detailed set of measurements that are needed to obtain a more complete understanding of the life cycle of shallow clouds by coupling cloud macrophysical and microphysical properties to land surface properties, ecosystems, and aerosols. HI-SCALE consists of 2, 4-week intensive observational periods, one in the spring and the other in the late summer, to take advantage of different stages and distribution of “greenness” for various types of vegetation in the vicinity of the Atmospheric Radiation and Measurement (ARM) Climate Research Facility’s Southern Great Plains (SGP) site as well as aerosol properties that vary during the growing season. Most of the proposed instrumentation will be deployed on the ARM Aerial Facility (AAF) Gulfstream 1 (G-1) aircraft, including those that measure atmospheric turbulence, cloud water content and drop size distributions, aerosol precursor gases, aerosol chemical composition and size distributions, and cloud condensation nuclei concentrations. Routine ARM aerosol measurements made at the surface will be supplemented with aerosol microphysical properties measurements. The G-1 aircraft will complete transects over the SGP Central Facility at multiple altitudes within the boundary layer, within clouds, and above clouds.

Fast, JD↗
DOE OSTI2020

Installation and commissioning of the ion source systems for the new spallation neutron source 2.5 MeV injector

The U.S. Spallation Neutron Source (SNS) is a state-of-the-art neutron scattering facility delivering the world’s most intense pulsed neutron beams to a wide array of instruments, which are used to conduct investigations in many fields of engineering, physics, chemistry, material science, and biology. Neutrons are produced by spallation of liquid Hg by the bombardment of short (∼1 µs), intense (∼35 A) pulses of protons delivered at 60 Hz by an accumulator ring which is fed by a high-intensity, 1 GeV, H− LINAC (linear accelerator). This facility has operated nearly continuously since 2006 but has recently undergone a 4-month maintenance period, which featured a complete replacement of the 2.5 MeV injector feeding the LINAC. The new injector was developed at ORNL in an off-line beam test facility and consists of an ion source, low energy beam transport, and a Radio Frequency Quadrupole (RFQ). This report first describes the installed configuration of the new injector detailing the ion source system. The first beam current, RFQ transmission, emittance, and energy measurements from the injector installed on the SNS are reported. These data not only show a significant performance improvement for our existing facility but will also make accessible the higher beam current requirements for future SNS upgrade projects: the proton power upgrade and second target station.

Welton, R. F.↗
DOE OSTI2018

Supercomputers, Clouds and Grids powered by BigPanDA for Brain studies

The PanDA WMS - Production and Distributed Analysis Workload Management System - has been developed and used by the ATLAS experiment at the LHC (Large Hadron Collider) for all data processing and analysis challenges. BigPanDA is an extension of the PanDA WMS to run ATLAS and non-ATLAS applications on Leadership Class Facilities and supercomputers, as well as traditional grid and cloud resources. The success of the BigPanDA project has drawn attention from other compute intensive sciences such as biology. In 2017, a pilot project was started between BigPanDA and the Blue Brain Project (BBP) of the Ecole Polytechnique Federal de Lausanne (EPFL) located in Lausanne, Switzerland. This proof of concept project is aimed at demonstrating the efficient application of the BigPanDA system to support the complex scientific workflow of the BBP, which relies on using a mix of desktop, cluster and supercomputers to reconstruct and simulate accurate models of brain tissue.

Computer Science↗
DOE OSTI2023

Curifactory: A research experiment manager

Curifactory is a command line tool and framework for organizing Python experiment code, configuration parameters, and results. It is an opinionated and lightweight approach to workflow management infrastructure and is primarily intended to support researchers conducting experiments on one machine. This software was developed to support the reproducibility of results for several data science projects in the Nuclear Nonproliferation Division at Oak Ridge National Laboratory. Curifactory is intended to be a general framework and is not specific to machine learning or data science. It can aid in any field in which experiments are primarily computation-based studies and can be implemented in Python (e.g., high-energy physics, astronomy, computational chemistry). Here, the design emphasizes the automated caching of intermediate data analysis artifacts to speed up development involving computationally intensive tasks. It also allows for data provenance and experiment reproduction. Individual experiment runs are tracked through logs and their output reports, and entire copies of a run with all cached data and metadata can be exported for others to run using Curifactory on another machine. Curifactory experiments can either be integrated into a project from the beginning or can be written on top of an existing codebase without needing significant modification. A few important views of the Curifactory library can be seen in Figure 1.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

RTN-011: Rubin Observatory Plans for an Early Science Program

This document outlines Rubin Observatory's plans for a dedicated \emph{Early Science Program} to enable high-impact science prior to the first annual data release of the Legacy Survey of Space and Time (LSST). Components of the Early Science Program include releasing science-grade commissioning data products via a series of ``Data Previews,'' ramping up of the transient alert stream during commissioning, implementing a program of incremental template generation to augment alert production in the early phases of the survey, and the first LSST Data Release, DR1, based on the first 6 months of data from the LSST. A detailed breakdown of which data products can be expected when is provided. The Rubin Operations team is working closely with the science community to optimize the Early Science Program for the time-domain and solar system science achievable in the first year of operations. This is a living document; both it and the Early Science Program will continue to evolve over the course of commissioning and pre-operations in response to the state of the as-built system and to community guidance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

CROCUS Forward Scatter Disdrometer Data at Argonne National Laboratory Prairie Site

The Vaisala FD70 is a multi-parameter present weather and visibility sensor designed to measure precipitation type, intensity, and visibility with high accuracy in diverse environmental conditions. It uses a combination of forward-scatter measurement and optical disdrometer technologies to detect drop size, fall speeds, and optical properties, enabling the classification of various precipitation types such as rain, snow, sleet, and freezing rain along is visibility estimates. The FD70 provides quantitative estimates of liquid-equivalent precipitation rate and meteorological optical range (MOR), supporting applications in meteorological research, aviation, and road weather monitoring. These measurements are collected at the Argonne Testbed for Multiscale Observational Science (ATMOS), a 20 acre prairie site at Argonne National Lab, located in Lemont, IL. Data is available in netcdf format. Each file contains one second interval data, for approximately 24 hrs each day. File naming convention includes the project (CROCUS), location (ATMOS), instrument name, data level (raw, a1), and date (year, month, day).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Data mining graphene: Correlative analysis of structure and electronic degrees of freedom in graphenic monolayers with defects

The link between changes in the material crystal structure and its mechanical, electronic, magnetic, and optical functionalities known as the structure-property relationship is the cornerstone of the contemporary materials science research. The recent advances in scanning transmission electron and scanning probe microscopies (STEM and SPM) have opened an unprecedented path towards examining the materials structure property relationships on the single-impurity and atomic-configuration levels. Lacking, however, are the statistics-based approaches for cross-correlation of structure and property variables obtained in different information channels of the STEM and SPM experiments. Here we have designed an approach based on a combination of sliding window Fast Fourier Transform, Pearson correlation matrix, linear and kernel canonical correlation, to study a relationship between lattice distortions and electron scattering from the SPM data on graphene with defects. Our analysis revealed that the strength of coupling to strain is altered between different scattering channels which can explain coexistence of several quasiparticle interference patterns in the nanoscale regions of interest. In addition, the application of the kernel functions allowed us extracting a non-linear component of the relationship between the lattice strain and scattering intensity in graphene. Lastly, the outlined approach can be further utilized to analyzing correlations in various multi-modal imaging techniques where the information of interest is spatially distributed and has usually a complex multidimensional nature.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Exploring cosmic origins with CORE: Mitigation of systematic effects

Here, we present an analysis of the main systematic effects that could impact the measurement of CMB polarization with the proposed CORE space mission. We employ timeline-to-map simulations to verify that the CORE instrumental set-up and scanning strategy allow us to measure sky polarization to a level of accuracy adequate to the mission science goals. We also show how the CORE observations can be processed to mitigate the level of contamination by potentially worrying systematics, including intensity-to-polarization leakage due to bandpass mismatch, asymmetric main beams, pointing errors and correlated noise. We use analysis techniques that are well validated on data from current missions such as Planck to demonstrate how the residual contamination of the measurements by these effects can be brought to a level low enough not to hamper the scientific capability of the mission, nor significantly increase the overall error budget. We also present a prototype of the CORE photometric calibration pipeline, based on that used for Planck, and discuss its robustness to systematics, showing how CORE can achieve its calibration requirements. While a fine-grained assessment of the impact of systematics requires a level of knowledge of the system that can only be achieved in a future study phase, the analysis presented here strongly suggests that the main areas of concern for the CORE mission can be addressed using existing knowledge, techniques and algorithms.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2013

An Efficient Deterministic Parallel Algorithm for Adaptive Multidimensional Numerical Integration on GPUs

Recent development in Graphics Processing Units (GPUs) has enabled a new possibility for highly efficient parallel computing in science and engineering. Their massively parallel architecture makes GPUs very effective for algorithms where processing of large blocks of data can be executed in parallel. Multidimensional integration has important applications in areas like computational physics, plasma physics, computational fluid dynamics, quantum chemistry, molecular dynamics and signal processing. The computationally intensive nature of multidimensional integration requires a high-performance implementation. In this study, we present an efficient deterministic parallel algorithm for adaptive multidimensional numerical integration on GPUs. Various optimization techniques are applied to maximize the utilization of the GPU. GPU-based implementation outperforms the best known sequential methods and achieves a speed-up of up to 100. It also shows good scalability with the increase in dimensionality.

Arumugam, Kamesh↗
DOE OSTI2018

Magnetic Microcalorimeter Gamma-Detectors for High-Accuracy Nuclear Decay Data

Magnetic microcalorimeters (MMCs) are low-energy gamma-ray detectors with ultra-high energy resolution that are operated at temperatures below 50 mK. They use metallic Au absorbers and paramagnetic Ag:Er sensors to measure gamma-ray energies from an increase in detector temperature. Ultra-low temperatures are made accessible to non-expert users with “dry” dilution refrigerators that replace the traditional liquid N 2 and He pre-cooling with a mechanically cooled pulse-tube refrigerator. Our MMC gamma detectors have achieved an energy resolution below 40 eV FWHM at 60 keV, and they have a uniform and reproducible response function that allows adding spectra from different detector pixels without loss in energy resolution. These properties make MMCs well-suited to re-measure nuclear decay data with increased precision and smaller systematic errors to increase the accuracy of non-destructive assays (NDA). We present recent MMC gamma-ray spectra of Th-234 to show how MMCs can resolve lines that are relevant for NDA analysis and that overlap in Ge spectra. We also discuss the accuracy that MMCs can achieve for nuclear decay data with an emphasis on gamma-ray energies and intensity ratios that current NDA codes are based on.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2012

A High Count Rate Beam Monitor for Thermal Neutrons

Beam monitors are an important diagnostic tool in neutron science facilities. Present beam monitors use either ionization chambers in integration mode, which are slow and have no timing information, or pulse counters which can easily be saturated by high beam intensities. Neutron beam monitors indicate the number of neutrons incident on a scattering sample and allow neutron experimental data to be analyzed even when the source strength varies with time. At high flux neutron scattering facilities, neutron beam monitors with very low efficiency (10-5) are presently selected to keep the counting rate within a feasible range, even when a higher efficiency would improve the counting statistics and yield a better measurement of the incident beam. In this work, we report on a high count rate neutron beam monitor which also offers position sensitivity to provide a beam profile. This beam monitor offers good timing (less than 1 s) in addition to position resolution and will therefore improve the counting statistics at neutron energies up to 10 eV and allow moderator studies. The detector s main characteristics will be presented including its background rate, its count rate capability which is an order of magnitude higher than present counting monitors, and its efficiency for thermal neutrons.

Barnett, Amanda↗
DOE OSTI2019

Exploring Energy-Efficient and Sustainable Urban Mobility Strategies: An Initial Framework to Curate Data/Models, Measure Performance, and Diffuse Innovation: Preprint

Many cities across the United States seek to understand the maturity of data and models that are available to help manage challenges, opportunities, and uncertainties associated with the shifts in technologies, human behaviors and sustainable urban mobility strategies. One key question identified for smart city action planning includes how to best shape continuous improvements for urban populations at the intersection of mobility, energy, and quality of life? With the emerging megatrends of urbanization (more than 70% of world population in cities by 2050), on-demand shared mobility, vehicle electrification, and automated vehicles, initial 'urban science' studies to date have demonstrated the potential and need for maturing the related data and model ecosystems and on-going performance measurement across multiple urban system goals: e.g., from more mobility, clean and efficient energy use, accessibility and safety to less air pollution, traffic, and resource-intensive urban sprawl. To build on emerging literature and understand city responses to disruptive change, this initial study engages researchers and practitioners across four smart city finalists (Columbus, Denver, Austin and Portland) that competed in the U.S. Department of Transportation (DOT) Smart City Challenge. The initial results emphasize the need for a suite of datasets and diverse analytical approaches that support U.S. Department of Energy (DOE) relevant research with cities. Considering desirable energy and mobility outcomes as a first step to advancing smart city solutions strategies, we systematically review approaches of and shortcomings in four U.S. cities, and suggest improvements in three areas: measurement, modeling effectiveness of new mobility technologies, and data-driven governance.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2015

Understanding reliability and some limitations of the images and spectra reconstructed from a multi-monochromatic x-ray imager

Temperature and density asymmetry diagnosis is critical to advance inertial confinement fusion (ICF) science. A multi-monochromatic x-ray imager (MMI) is an attractive diagnostic for this purpose. The MMI records the spectral signature from an ICF implosion core with time resolution, 2-D space resolution, and spectral resolution. While narrow-band images and 2-D space-resolved spectra from the MMI data constrain temperature and density spatial structure of the core, the accuracy of the images and spectra depends not only on the quality of the MMI data but also on the reliability of the post-processing tools. In this paper, we synthetically quantify the accuracy of images and spectra reconstructed from MMI data. Errors in the reconstructed images are less than a few percent when the space-resolution effect is applied to the modeled images. The errors in the reconstructed 2-D space-resolved spectra are also less than a few percent except those for the peripheral regions. Spectra reconstructed for the peripheral regions have slightly but systematically lower intensities by ~6% due to the instrumental spatial-resolution effects. However, this does not alter the relative line ratios and widths and thus does not affect the temperature and density diagnostics. We also investigate the impact of the pinhole size variation on the extracted images and spectra. A 10% pinhole size variation could introduce spatial bias to the images and spectra of ~10%. A correction algorithm is developed, and it successfully reduces the errors to a few percent. Finally, it is desirable to perform similar synthetic investigations to fully understand the reliability and limitations of each MMI application.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

SITCOMTN-154: Initial studies of photometric redshifts with LSSTComCam from DP1

This technote holds reports based on the first analyses of the Data Preview 1 (DP1) data by the Science Unit for photometric redshifts. Although photometric redshifts are not an official DP1 data product, the "Photo-z Science Unit" generated photo-z estimates for every galaxy in DP1 using the available multi-band imaging on a best-effort basis. This work included developing training and test datasets by matching DP1 data to high-quality reference redshifts obtained with spectroscopy, Grism data, and multi-band photometry. The Science Unit used the RAIL software package to make photometric redshift estimates using eight different algorithms, developed simple scientific performance metrics, used those metrics to explore how the performance of the algorithms varied with configuration changes, derived more optimized configurations of the algorithms and tested the performance of those configurations. This work, the resulting data products and expected data distribution mechanism are all described there.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

ARM Data for Examining the Ice-Nucleating Particles from SGP Part II (ExINP-SGP II) X-Ray Diffraction

Knowledge of airborne particulate matter (PM), especially the particles that have supermicron diameters, is key for understanding ice-nucleating particles (INPs). Supported by the Atmospheric Radiation Measurement (ARM) user facility, we sampled PM and surface soil materials at the Southern Great Plains observatory (SGP; 36° 36′ 18″ N, 97° 29′ 6″ W) to systematically compare the INP abundance and ice nucleation efficiency of different SGP samples (i.e., airborne versus surface materials). The field campaign, named Examing INP from SGP II (ExINP-SGP II), was conducted from 20 January to 20 April, 2021. Our data analysis products include (1) physical surface sorption characterization data (i.e., BET, pore volume) of two sets of samples -- SGP Soil and USDA, (2) X-ray diffraction spectra for the same two samples, (3) immersion freezing assay-based ice nucleation active mass density data as a function of freezing temperature for both ambient and surface samples, and (4) time-series data of ambient meteorological conditions, concentration particle counter-derived aerosol particle concentration, and aerosol particle sizer measurement during ExINP-SGP II.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.

Rettenberger, Luca↗