Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Intensive Science”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

New Particle Formation Event Dataset at the Southern Great Plains (SGP) Observatory from 2018 to 2023

This data set contains observations of new particle formation (NPF) events collected at the U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) observatory from 2018 to 2023. Measurements include particle number size distributions, radiance measurements, and associated meteorological variables from onsite instrumentation relevant for identifying and characterizing NPF events. Events were identified using standardized criteria and documented to support investigations of aerosol nucleation, growth dynamics, and their interactions with local atmospheric conditions. The data set provides a multi-year record that enables evaluation of seasonal and interannual variability in NPF occurrence and intensity at a mid-continental site. These data are intended to support studies of aerosol-cloud-climate interactions and model evaluation within both ARM and the broader atmospheric science community. More information can be found within the README_NPF_SGP_2018_2023.docx file.

event↗
DOE OSTI2022

Combustion machine learning: Principles, progress and prospects

Progress in combustion science and engineering has led to the generation of large amounts of data from large-scale simulations, high-resolution experiments, and sensors. This corpus of data offers enormous opportunities for extracting new knowledge and insights—if harnessed effectively. Machine learning (ML) techniques have demonstrated remarkable success in data analytics, thus offering a new paradigm for data-intense analyses and scientific investigations through combustion machine learning (CombML). While data-driven methods are utilized in various combustion areas, recent advances in algorithmic developments, the accessibility of open-source software libraries, the availability of computational resources, and the abundance of data have together rendered ML techniques ubiquitous in scientific analysis and engineering. This article examines ML techniques for applications in combustion science and engineering. Starting with a review of sources of data, data-driven techniques, and concepts, we examine supervised, unsupervised, and semi-supervised ML methods. Various combustion examples are considered to illustrate and to evaluate these methods. Next, we review past and recent applications of ML approaches to problems in combustion, spanning fundamental combustion investigations, propulsion and energy-conversion systems, and fire and explosion hazards. Challenges unique to CombML are discussed and further opportunities are identified, focusing on interpretability, uncertainty quantification, robustness, consistency, creation and curation of benchmark data, and the augmentation of ML methods with prior combustion-domain knowledge.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

CHESS 2025: Orthorectified airborne RGB imagery from NEON AOP surveys

This dataset provides Level 1 (L1) and Level 3 (L3) orthorectified Red-Green-Blue (RGB) imagery collected for the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS). This high-resolution imagery is a photographic record of red, green, and blue visible light from sunlight reflected off of the Earth’s surface. The data comprise full-color images of the ground surface and are primarily intended to provide context to imaging spectroscopy and light detection and ranging (LiDAR) data. The data were acquired over three study domains in the Upper Gunnison river basin: the upper East River watershed (CRBU); Almont Triangle and Taylor Canyon (ALMO); and Upper Taylor River watershed (UPTA) between 2025-06-13 and 2025-07-15. RGB images were acquired using the PhaseOne IXM-RS150F high-resolution digital camera onboard the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP). The package data include both an L1 product comprising one camera frame per file and an L3 mosaic aligned to the Universal Transverse Mercator (UTM) Zone 13N grid and the World Geodetic System (WGS) 84 projection. Both products are provided in geotif (.tif) format at 0.1 m ground resolution. The bulk of the imagery was collected during the main CHESS field campaign from June 13 to July 15, 2025. Additional images of a portion of the Upper Taylor (UPTA) domain were collected on September 18, 2025, to fill gaps in imagery identified after the main campaign was complete. RGB camera imagery is not radiometrically calibrated, and therefore pixel values should not be exploited for scientific analysis. Pixel values have undergone a manual adjustment to enhance feature identification. The imagery is rigorously geolocated which does allow for reliable geometric information to be retrieved. To generate the orthorectified imagery, the NEON AOP camera captured visible spectrum in red, green, and blue bands. The raw images were then processed using NEON’s camera orthorectification workflow. A boresight calibration flight was made to build a complete camera, distortion, and alignment model. Color balance/white balance and exposure correction were applied to the raw RGB images. The corrected images were orthorectified by ray-tracing image pixels to a lidar-derived digital surface model (DSM) mesh using the refined camera model, outputting orthorectified raster pixels on a regular grid. Flightline-level data were mosaicked by selecting per-pixel contributions from overlapping orthorectified images using line-of-sight (LOS) zenith angle minimization to reduce edge distortions. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgement: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2016

Observations and Modeling of the Green Ocean Amazon 2014/15: Hydroxyl Radical (OH) Chemical Ionization Mass Spectrometer (CIMS) Field Campaign Report

The University of California, Irvine, science team (Dr. Saewung Kim, Dr. Roger Seco, Dr. Alex Guenther, and Dr. Jim Smith) deployed a chemical ionization mass spectrometer system for hydroxyl radical (OH) and sulfuric acid quantifications. As part of the GoAmazon 2014/15 field campaign. Hydroxyl radical determines tropospheric oxidation capacity and had been expected to be very low in the pristine rain forest region such as the Brazilian Amazon because of the presence of significant levels of highly reactive biogenic volatile organic compounds and very low levels of NO, which is an OH recycling agent. However, several recent in situ OH observations provided by a laser-induced fluorescence system reported unaccountably high OH concentrations. To address this discrepancy, a series of laboratory and theoretical studies has postulated chemical reaction mechanisms of isoprene that may regenerate OH in photo-oxidation processes. Along with these efforts, potential artifacts on the laser induced fluorescence system from isoprene and its oxidation products also have been explored. Therefore, the first chemical ionization mass spectrometer observations at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility’s T3 site in Manacapuru, Brazil, are expected to provide a critical experimental constraint to address uncertainty in constraining oxidation capacity over pristine rain forest environments. In addition, we deployed a National Center for Atmospheric Research (NCAR) proton transfer reaction time-of-flight mass spectrometer to characterize atmospheric volatile organic compound levels, especially isoprene and its oxidation products, which are critical input parameters for box modeling to simulate OH with different isoprene photo-oxidation schemes. As there has been no report on noticeable new particle formation events, our first in situ sulfuric acid observations in the Amazon rain forest were expected to constrain the reasons behind such observations. The planned field observations during Intensive Observational Periods I and II, post-field campaign calibrations, and preliminary data reports have been completed. We presented preliminary data analysis results at the 2014 American Geophysical Union Fall meeting and the GOAmazon Science Meeting in Boston (May 2015). We are in the process of submitting two more abstracts to the 2015 American Geophysical Union fall meeting while we are preparing two manuscripts to be submitted to (tentatively) the GOAmazon special issue of Atmospheric Chemistry and Physics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

TRACER CLAMPS1 Doppler Lidar Vertical Stare Data

These files contain 24 hour periods of data collected from the CLAMPS1 Halo Streamline Doppler lidar. While not conducting other scans, the lidar directs the beam to zenith, allowing for the measurement of vertical velocity. These data were collected during the TRACER project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Recent evolution of the offline computing model of the NOvA experiment

The NOvA experiment at Fermilab is a long-baseline neutrino experiment designed to study ν e appearance in a ν μ beam. Over the last few years there has been intense work to streamline the computing infrastructure in preparation for data, which started to flow in from the far detector in Fall 2013. Major accomplishments for this effort include migration to the use of off-site resources through the use of the Open Science Grid and upgrading the file-handling framework from simple disk storage to a tiered system using a comprehensive data management and delivery system to find and access files on either disk or tape storage. NOvA has already produced more than 6.5 million files and more than 1 PB of raw data and Monte Carlo simulation files which are managed under this model. In addition, the current system has demonstrated sustained rates of up to 1 TB/hour of file transfer by the data handling system. NOvA pioneered the use of new tools and this paved the way for their use by other Intensity Frontier experiments at Fermilab. Most importantly, the new framework places the experiment's infrastructure on a firm foundation, and is ready to produce the files needed for first physics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Method of monitoring photoactive organic molecules in-situ during gas-phase deposition of the photoactive organic molecules

A method for in-situ monitoring of gas-phase photoactive organic molecules in real time while depositing a film of the photoactive organic molecules on a substrate in a processing chamber for depositing the film includes irradiating the gas-phase photoactive organic molecules in the processing chamber with a radiation from a radiation source in-situ while depositing the film of the one or more organic materials and measuring the intensity of the resulting photoluminescence emission from the organic material. One or more processing parameters associated with the deposition process can be determined from the photoluminescence intensity data in real time providing useful feedback on the deposition process.

14 SOLAR ENERGY↗
DOE OSTI2014

Atmospheric Research Measurement Climate Research Facility - Atmospheric System Research High-Resolution Modeling Workshop, May 19-20, 2014

The Atmospheric Radiation Measurement (ARM) Climate Research Facility is a scientific user facility within the U.S. Department of Energy (DOE) Climate and Environmental Sciences Division (CESD) of the Office of Biological and Environmental Research (BER). ARM is an observation facility whose purpose is to provide ground-based observations of the atmosphere to support climate research and to support the improvement of global climate models. ARM is closely affiliated with the Atmospheric System Research (ASR) program, which uses ARM data to address key atmospheric science issues and improve the parameterization of physical processes in climate models. A common methodology for using ARM data to improve climate models has been to carry out multi-model evaluation projects, typically in conjunction with field campaigns in which intensive radiosonde launches support the development of model forcing data sets. These exercises have yielded important insights. However, in recent years, there has been a growing interest in supporting high-resolution model simulations on a more routine basis. An important aspect of ARM sites is the continuous collection of high-resolution data over long periods of time. More routine model simulations would take better advantage of these long-term data sets. Nevertheless, accomplishing this will require careful attention to the requirements for running and evaluating these models together with a research program that maximizes the benefit of the model output.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2011

Power- and Cooling-Aware Parallel Performance Diagnosis

Increasing concern about the power consumption of data centers and computer laboratories, which in some cases matches or exceeds the resources required to power a small city, drive a need for a new, integrated approach to parallel performance diagnosis that integrates traditional application oriented performance data with measurements of the physical runtime environment. We have developed infrastructure for combined evaluation of system, application, and machine room performance in the high end environment. We motivate our approach, with a case study of the performance, power and cooling impact of the choice of physical location for a scientific application within the machine room. We present a new intensity metric for use in automated performance diagnosis tools, and discuss the challenges encountered.

Environmental Molecular Sciences Laboratory↗
DOE OSTI2021

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Morphology and Evolution of 14Cr Powder During Mechanical Alloying for Oxide Dispersion Strengthened Ferritic Alloys

Oxide Dispersion Strengthened (ODS) Ferritic steel alloys are candidate materials for Generation IV and Fusion reactor concepts due to their high temperature material properties and their irradiation stability. However, these material properties are strongly influenced by nanocluster dispersion and grain size distributions, which are directly correlated to mechanical alloying methodologies and parameters. Current powder processing strategies use ball milling times greater than or equal to 40 hrs to achieve sufficient dispersoid, i.e Y{sub 2}O{sub 3}, incorporation within the metal matrix, but these time intensive milling cycles are neither practical nor economical. This work aims to investigate how the particle morphology evolves during mechanical alloying during the processing of a 14Cr ODS ferritic alloy, and if higher-intensity milling, shorter milling cycles can still achieve sufficient mixing of yttria in comparison to the dispersion and incorporation observed in conventional lower-intensity milling methodologies. Comparisons of milled particle size distributions are presented for low and high intensity milling cycles, while microscopy and high-temperature tensile data are presented for consolidated samples using higher-intensity milling parameters. (authors)

36 MATERIALS SCIENCE↗
DOE OSTI2019

Volumetric Segmentation via Neural Networks Improves Neutron Crystallography Data Analysis

Crystallography is the powerhouse technique for molecular structure determination, with applications in fields ranging from energy storage to drug design. Accurate structure determination, however, relies partly on determining the precise locations and integrated intensities of Bragg peaks in the resulting data. Here, we describe a method for Bragg peak integration that is accomplished using neural networks. The network is based on a U-Net and identifies peaks in three-dimensional reciprocal space through segmentation, allowing prediction of the full 3D peak shape from noisy data that is commonly difficult to process. The procedure for generating appropriate training sets is detailed. Trained networks achieve Dice coefficients of 0.82 and mean IoUs of 0.69. Carrying out integration over entire datasets, it is demonstrated that integrating neural network-predicted peaks results in improved intensity statistics. Furthermore, using a second dataset, the possibility of transfer learning between datasets is shown. Given the ubiquity and growing complexity of crystallography, we anticipate integration by machine learning to play an increasingly important role across the physical sciences. These early results demonstrate the applicability of deep learning techniques for integrating crystallography data and suggest a possible role in the next generation of crystallography experiments.

Sullivan, Brendan T.↗
DOE OSTI2022

AMX – the highly automated macromolecular crystallography (17-ID-1) beamline at the NSLS-II

The highly automated macromolecular crystallography beamline AMX/17-ID-1 is an undulator-based high-intensity (>5 × 10 12 photons s −1 ), micro-focus (7 µm × 5 µm), low-divergence (1 mrad × 0.35 mrad) energy-tunable (5–18 keV) beamline at the NSLS-II, Brookhaven National Laboratory, Upton, NY, USA. It is one of the three life science beamlines constructed by the NIH under the ABBIX project and it shares sector 17-ID with the FMX beamline, the frontier micro-focus macromolecular crystallography beamline. AMX saw first light in March 2016 and started general user operation in February 2017. At AMX, emphasis has been placed on high throughput, high capacity, and automation to enable data collection from the most challenging projects using an intense micro-focus beam. Here, the current state and capabilities of the beamline are reported, and the different macromolecular crystallography experiments that are routinely performed at AMX/17-ID-1 as well as some plans for the near future are presented.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Reviews and syntheses: The promise of big diverse soil data, moving current practices towards future potential

Abstract. In the age of big data, soil data are more available and richer than ever, but – outside of a few large soil survey resources – they remain largely unusable for informing soil management and understanding Earth system processes beyond the original study. Data science has promised a fully reusable research pipeline where data from past studies are used to contextualize new findings and reanalyzed for new insight. Yet synthesis projects encounter challenges at all steps of the data reuse pipeline, including unavailable data, labor-intensive transcription of datasets, incomplete metadata, and a lack of communication between collaborators. Here, using insights from a diversity of soil, data, and climate scientists, we summarize current practices in soil data synthesis across all stages of database creation: availability, input, harmonization, curation, and publication. We then suggest new soil-focused semantic tools to improve existing data pipelines, such as ontologies, vocabulary lists, and community practices. Our goal is to provide the soil data community with an overview of current practices in soil data and where we need to go to fully leverage big data to solve soil problems in the next century.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

A new ATLAS muon CSC readout system with system on chip technology on ATCA platform

The ATLAS muon Cathode Strip Chamber (CSC) back-end readout system has been upgraded during the LHC 2013-2015 shutdown to be able to handle the higher Level-1 trigger rate of 100 kHz and the higher occupancy at Run 2 luminosity. The readout design is based on the Reconfiguration Cluster Element (RCE) concept for high bandwidth generic DAQ implemented on the ATCA platform. The RCE design is based on the new System on Chip Xilinx Zynq series with a processor-centric architecture with ARM processor embedded in FPGA fabric and high speed I/O resources together with auxiliary memories to form a versatile DAQ building block that can host applications tapping into both software and firmware resources. The Cluster on Board (COB) ATCA carrier hosts RCE mezzanines and an embedded Fulcrum network switch to form an online DAQ processing cluster. More compact firmware solutions on the Zynq for G-link, S-link and TTC allowed the full system of 320 G-links from the 32 chambers to be processed by 6 COBs in one ATCA shelf through software waveform feature extraction to output 32 S-links. Furthermore, the full system was installed in Sept. 2014. We will present the RCE/COB design concept, the firmware and software processing architecture, and the experience from the intense commissioning towards LHC Run 2.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Accelerating Discovery of Atomistic Defects via Machine Learning

The quantification of defects such as vacancies in crystalline structures is a cornerstone of materials science research. Traditional efforts often rely on manual detection, a process that is time-intensive, prone to human error, and challenging to scale. Here we leverage machine learning (ML) methods to identify and quantify vacancies within a crystalline lattice, aiming to expedite detection while improving accuracy. Additionally, we explore the transferability of these ML techniques, identifying characteristics of atomistic imaging data that complicate this task. We show how the integration of ML can drive innovation, providing a powerful tool that will play an increasingly crucial role in the future of materials science.

2D materials↗
DOE OSTI2016

Report of the 2014 Programming Models and Environments Summit

Programming models and environments play the essential roles in high performance computing of enabling the conception, design, implementation and execution of science and engineering application codes. Programmer productivity is strongly influenced by the effectiveness of our programming models and environments, as is software sustainability since our codes have lifespans measured in decades, so the advent of new computing architectures, increased concurrency, concerns for resilience, and the increasing demands for high-fidelity, multi-physics, multi-scale and data-intensive computations mean that we have new challenges to address as part of our fundamental R&D requirements. Fortunately, we also have new tools and environments that make design, prototyping and delivery of new programming models easier than ever. The combination of new and challenging requirements and new, powerful toolsets enables significant synergies for the next generation of programming models and environments R&D. This report presents the topics discussed and results from the 2014 DOE Office of Science Advanced Scientific Computing Research (ASCR) Programming Models & Environments Summit, and subsequent discussions among the summit participants and contributors to topics in this report.

97 MATHEMATICS AND COMPUTING↗