Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

The LSST DESC DC2 Simulated Sky Survey

Here, we describe the simulated sky survey underlying the second data challenge (DC2) carried out in preparation for analysis of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) by the LSST Dark Energy Science Collaboration (LSST DESC). Significant connections across multiple science domains will be a hallmark of LSST; the DC2 program represents a unique modeling effort that stresses this interconnectivity in a way that has not been attempted before. This effort encompasses a full end-to-end approach: starting from a large N-body simulation, through setting up LSST-like observations including realistic cadences, through image simulations, and finally processing with Rubin's LSST Science Pipelines. This last step ensures that we generate data products resembling those to be delivered by the Rubin Observatory as closely as is currently possible. The simulated DC2 sky survey covers six optical bands in a wide-fast-deep area of approximately 300 deg 2 , as well as a deep drilling field of approximately 1 deg 2 . We simulate 5 yr of the planned 10 yr survey. The DC2 sky survey has multiple purposes. First, the LSST DESC working groups can use the data set to develop a range of DESC analysis pipelines to prepare for the advent of actual data. Second, it serves as a realistic test bed for the image processing software under development for LSST by the Rubin Observatory. In particular, simulated data provide a controlled way to investigate certain image-level systematic effects. Finally, the DC2 sky survey enables the exploration of new scientific ideas in both static and time domain cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Toward a Seamless Integration of Computing, Experimental, and Observational Science Facilities: A Blueprint to Accelerate Discovery

The Department of Energy, Office of Science operates world-leading facilities for experimental, observational, and computational science. DOE supercomputing facilities will reach performance at the scale of ExaFLOPs in the coming years, enabling new vistas of scale and precision for large scale simulations and data analysis. Experimental scientific facilities are undergoing similar upgrades that will lead to higher data rates and correspondingly larger computational demands, and will increase the need for near-real-time processing and resilient support for more complex workflows. A transformation of science is underway, with workloads at supercomputing facilities increasingly driven by this explosion of data from instruments and experimental facilities, as well as the accelerating use of Artificial Intelligence (AI) as a tool for scientific discovery. A seamless integration of computing, networking, instruments, and experimental facilities is required to support these emerging workloads and open up a new frontier of U.S. leadership in scientific discovery. We propose to accomplish this by providing frictionless access to the ASCR supercomputing facilities. We describe our vision of combining the power of ASCR supercomputers and networking infrastructure into an integrated scalable fabric, available to end user scientists via interfaces that aim to automate and simplify access to high performance computing systems. This will enable unprecedented computational science capabilities for experimental and observational facilities, and will create new opportunities to combine large simulations and modeling with experimental facility data analysis. This blueprint for creating an integrated network of computational and experimental facilities will provide an enriched discovery environment and open doors for new scientific communities to access the DOE’s world-leading computing and networking capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Integrative data-driven approaches for characterization & prediction of aerosol-cloud processes

Focal Area: Advanced methods to glean insights from complex data (Focal Area 3). Science Challenge: Fusing and interpreting the vast amount of data from disjoint sources for the purpose of elevating our understanding of aerosol-cloud interaction presents an enormous challenge and opportunity and is necessary to improve uncertainty quantification and predictions, especially for extreme events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

SU-C-201-04: Quantification of Perfusion Heterogeneity Based On Texture Analysis for Fully Automatic Detection of Ischemic Deficits From Myocardial Perfusion Imaging

Purpose: Texture-based quantification of image heterogeneity has been a popular topic for imaging studies in recent years. As previous studies mainly focus on oncological applications, we report our recent efforts of applying such techniques on cardiac perfusion imaging. A fully automated procedure has been developed to perform texture analysis for measuring the image heterogeneity. Clinical data were used to evaluate the preliminary performance of such methods. Methods: Myocardial perfusion images of Thallium-201 scans were collected from 293 patients with suspected coronary artery disease. Each subject underwent a Tl-201 scan and a percutaneous coronary intervention (PCI) within three months. The PCI Result was used as the gold standard of coronary ischemia of more than 70% stenosis. Each Tl-201 scan was spatially normalized to an image template for fully automatic segmentation of the LV. The segmented voxel intensities were then carried into the texture analysis with our open-source software Chang Gung Image Texture Analysis toolbox (CGITA). To evaluate the clinical performance of the image heterogeneity for detecting the coronary stenosis, receiver operating characteristic (ROC) analysis was used to compute the overall accuracy, sensitivity and specificity as well as the area under curve (AUC). Those indices were compared to those obtained from the commercially available semi-automatic software QPS. Results: With the fully automatic procedure to quantify heterogeneity from Tl-201 scans, we were able to achieve a good discrimination with good accuracy (74%), sensitivity (73%), specificity (77%) and AUC of 0.82. Such performance is similar to those obtained from the semi-automatic QPS software that gives a sensitivity of 71% and specificity of 77%. Conclusion: Based on fully automatic procedures of data processing, our preliminary data indicate that the image heterogeneity of myocardial perfusion imaging can provide useful information for automatic determination of the myocardial ischemia.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Advances in the photon avalanche luminescence of inorganic lanthanide-doped nanomaterials

Photon avalanche (PA)—where the absorption of a single photon initiates a ‘chain reaction’ of additional absorption and energy transfer events within a material—is a highly nonlinear optical process that results in upconverted light emission with an exceptionally steep dependence on the illumination intensity. Over 40 years following the first demonstration of photon avalanche emission in lanthanide-doped bulk crystals, PA emission has been achieved in nanometer-scale colloidal particles. The scaling of PA to nanomaterials has resulted in significant and rapid advances, such as luminescence imaging beyond the diffraction limit of light, optical thermometry and force sensing with (sub)micron spatial resolution, and all-optical data storage and processing. In this review, we discuss the fundamental principles underpinning PA and survey the studies leading to the development of nanoscale PA. Finally, we offer a perspective on how this knowledge can be used for the development of next-generation PA nanomaterials optimized for a broad range of applications, including mid-IR imaging, luminescence thermometry, (bio)sensing, optical data processing and nanophotonics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

GSOD Based Daily Global Mean Surface Temperature and Mean Sea Level Air Pressure (1982-2011)

This data product contains all the gridded data set at 1/4 degree resolution in ASCII format. Both mean temperature and mean sea level air pressure data are available. It also contains the GSOD data (1982-2011) from NOAA site, contains station number, location, temperature and pressures (sea level and station level). The data package also contains information related to the data processing methods

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Use of the ARM Measurements of Spectral Zenith Radiance for Better Understanding of 3D Cloud-Radiation Processes & Aerosol-Cloud Interaction

This project focuses on cloud-radiation processes in a general three-dimensional cloud situation, with particular emphasis on cloud optical depth and effective particle size. The proposal has two main parts. Part one exploits the large number of new wavelengths offered by the Atmospheric Radiation Measurement (ARM) zenith-pointing ShortWave Spectrometer (SWS), to develop better retrievals not only of cloud optical depth but also of cloud particle size. We also take advantage of the SWS’ high sampling resolution to study the “twilight zone” around clouds where strong aerosol-cloud interactions are taking place. Part two involves continuing our cloud optical depth and cloud fraction retrieval research with ARM’s 2-channel narrow field-of-view radiometer and sunphotometer instrument by, first, analyzing its data from the ARM Mobile Facility deployments, and second, making our algorithms part of ARM’s operational data processing.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

BNF Radar b1 Data Processing Report: Spring 2025

The U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility supports atmospheric science through an integrated network of fixed and mobile observatories. These facilities collect continuous and campaign-based observations of atmospheric properties, with the goal of improving the representation of clouds, aerosols, precipitation, and radiation in Earth system models. The Bankhead National Forest (BNF) site, established as an ARM Mobile Facility (AMF) on 1 October 2024, is situated in a forested region of northern Alabama. Its strategic location in a southeastern U.S. environment characterized by complex terrain, diverse land cover, and frequent convective storms provides a valuable opportunity to examine coupled land-atmosphere processes under natural variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

SU-E-I-11: A New Cone-Beam CT System for Bedside Head Imaging

Purpose: To design and develop a new mobile cone-beam CT (CBCT) system for head imaging with good soft-tissue visibility, to be used bedside in ICU and neurosurgery department to monitor treatment and operation outcome in brain patients. Methods: The imaging chain consists of a 30cmx25cm amorphous silicon flat panel detector and a pulsed, stationary anode monoblock x-ray source of 100kVp at a maximal tube current of 10mA. The detector and source are supported on motorized mechanisms to provide detector lateral shift and source angular tilt, enabling a centered digital radiographic imaging mode and half-fan CBCT, while maximizing the use of the x-ray field and keep the source to detector distance short. A focused linear anti-scatter grid is mounted on the detector, and commercial software with scatter and other corrective algorithms is used for data processing and image reconstruction. The gantry rotates around a horizontal axis, and is able to adjust its height for different patient table positions. Cables are routed through a custom protective sleeve over a large bore with an in-plane twister band, facilitating single 360-degree rotation without a slip-ring at a speed up to 5 seconds per rotation. A UPS provides about 10 minutes of operation off the battery when unplugged. The gantry is on locked casters, whose brake is control by two push handles on both sides for easy reposition. The entire system is designed to have a light weight and a compact size for excellent maneuverability. Results: System design is complete and main imaging components are tested. Initial results will be presented and discussed later in the presentation. Conclusion: A new mobile CBCT system for head imaging is being developed. With its compact size, a large bore, and quality design, it is expected to be a useful imaging tool for bedside uses. The work is supported by a grant from Chinese Academy of Sciences.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

Performance and data analysis aspects of the new DIII-D monostatic profile reflectometer system

A new frequency-modulated profile reflectometer system, featuring a monostatic antenna geometry (using one microwave antenna for both launch and receive), has been installed on the DIII-D tokamak, providing a first experimental test of this measurement approach for profile reflectometry. Significant features of the new system are briefly described in this paper, including the new monostatic arrangement, use of overmoded, broadband transmission waveguide, and dual-polarization combination/demultiplexing. Updated data processing and analysis, and in-service performance aspects of the new monostatic profile reflectometer system are also presented. By using a raytracing code (GENRAY) to determine the approximate trajectory of the probe beam, the electron density (n{sub e}) profile can be successfully reconstructed with L-mode plasmas vertically shifted by more than 10 cm off the vessel midplane. Specifically, it is demonstrated that the new system has a capability to measure n{sub e} profiles with plasma vertical offsets of up to ±17 cm. Examples are also presented of accurate, high time and spatial resolution density profile measurements made over a wide range of DIII-D conditions, e.g., the measured temporal evolution of the density profile across a L-H transition.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

LCLS Big Data Handling – How I Learned to Stop Worrying and Love the Data Deluge

Advanced data and computing systems are vital to Linac Coherent Light Source (LCLS) operations, data interpretation and overall scientific productivity. The transition to MHz-era operation marks a fundamental change in scale that requires new infrastructure and architectures to link LCLS to the required scale of computing needed for scientific interpretation. The LCLS-II Data System meets big data challenges by implementing configurable data reduction that can adapt to multiple science areas, real-time analysis frameworks to provide visualization and fast feedback, and the ability to transfer data to local and remote computational facilities for near real time analysis at the appropriate scale. Feature extracted information generated in the data analysis pipeline - at the edge, local compute, or remote High-Performance Computing (HPC) resources - can be used to steer experiments and inform user decisions during beam time. Artificial Intelligence and Machine Learning (AI/ML) techniques present new opportunities to rapidly analyse large datasets and direct experiments, but create new challenges in scaling, adaptability, complexity, and trustworthiness. We describe how the LCLS-II Data System architecture addresses its data-driven challenges in the areas of data acquisition, data processing, data management, and workflow orchestration to decrease the overall time-to-science and provide a vision for future developments.

artificial intelligence↗
DOE OSTI2020

Efficient Data Management in Neutron Scattering Data Reduction Workflows at ORNL

Oak Ridge National Laboratory (ORNL) experimental neutron science facilities produce 1.2 TB a day of raw event-based data that is stored using the standard metadata-rich NeXus schema built on top of the HDF5 file format. Performance of several data reduction workflows is largely determined by the amount of time spent on the loading and processing algorithms in Mantid, an open-source data analysis framework used across several neutron sciences facilities around the world. The present work introduces new data management algorithms to address identified input output (I/O) bottlenecks on Mantid. First, we introduce an in-memory binary-tree metadata index that resemble NeXus data access patterns to provide a scalable search and extraction mechanism. Second, data encapsulation in Mantid algorithms is optimally redesigned to reduce the total compute and memory runtime footprint associated with metadata I/O reconstruction tasks. Results from this work show speed ups in wall-clock time on ORNL data reduction workflows, ranging from 11% to 30% depending on the complexity of the targeted instrument-specific data. Nevertheless, we highlight the need for more research to address reduction challenges as experimental data volumes increase.

Godoy, William↗
DOE OSTI2024

Quantum-centric supercomputing for materials science: A perspective on challenges and future directions

Computational models are an essential tool for the design, characterization, and discovery of novel materials. Computationally hard tasks in materials science stretch the limits of existing high-performance supercomputing centers, consuming much of their resources for simulation, analysis, and data processing. Quantum computing, on the other hand, is an emerging technology with the potential to accelerate many of the computational tasks needed for materials science. In order to do that, the quantum technology must interact with conventional high-performance computing in several ways: approximate results validation, identification of hard problems, and synergies in quantum-centric supercomputing. Here in this paper, we provide a perspective on how quantum-centric supercomputing can help address critical computational problems in materials science, the challenges to face in order to solve representative use cases, and new suggested directions.

36 MATERIALS SCIENCE↗
DOE OSTI2015

FACE-IT. A Science Gateway for Food Security Research

Progress in sustainability science is hindered by challenges in creating and managing complex data acquisition, processing, simulation, post-processing, and intercomparison pipelines. To address these challenges, we developed the Framework to Advance Climate, Economic, and Impact Investigations with Information Technology (FACE-IT) for crop and climate impact assessments. This integrated data processing and simulation framework enables data ingest from geospatial archives; data regridding, aggregation, and other processing prior to simulation; large-scale climate impact simulations with agricultural and other models, leveraging high-performance and cloud computing; and post-processing to produce aggregated yields and ensemble variables needed for statistics, for model intercomparison, and to connect biophysical models to global and regional economic models. FACE-IT leverages the capabilities of the Globus Galaxies platform to enable the capture of workflows and outputs in well-defined, reusable, and comparable forms. We describe FACE-IT and applications within the Agricultural Model Intercomparison and Improvement Project and the Center for Robust Decision-making on Climate and Energy Policy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Planck 2013 results. I. Overview of products and scientific results

The European Space Agency's Planck satellite, dedicated to studying the early Universe and its subsequent evolution, was launched 14 May 2009 and has been scanning the microwave and submillimetre sky continuously since 12 August 2009. In March 2013, ESA and the Planck Collaboration released the initial cosmology products based on the first 15.5 months of Planck data, along with a set of scientific and technical papers and a web-based explanatory supplement. This report gives an overview of the mission and its performance, the processing, analysis, and characteristics of the data, the scientific results, and the science data products and papers in the release. The science products include maps of the cosmic microwave background (CMB) and diffuse extragalactic foregrounds, a catalogue of compact Galactic and extragalactic sources, and a list of sources detected through the Sunyaev-Zeldovich effect. The likelihood code given to assess cosmological models against the Planck data and a lensing likelihood are described. Scientific results include robust support for the standard six-parameter ΛCDM model of cosmology and improved measurements of its parameters, including a highly significant deviation from scale invariance of the primordial power spectrum. The Planck values for these parameters and others derived from them are significantly different from those previously determined. Several large-scale anomalies in the temperature distribution of the CMB, first detected by WMAP, are confirmed with higher confidence. Planck sets new limits on the number and mass of neutrinos, and has measured gravitational lensing of CMB anisotropies at greater than 25σ. Planck finds no evidence for non-Gaussianity in the CMB. Planck's results agree well with results from the measurements of baryon acoustic oscillations. Planck finds a lower Hubble constant than found in some more local measures. Some tension is also present between the amplitude of matter fluctuations (σ8) derived from CMB data and that derived from Sunyaev-Zeldovich data. The Planck and WMAP power spectra are offset from each other by an average level of about 2% around the first acoustic peak. Analysis of Planck polarization data is not yet mature, therefore polarization results are not released, while the robust detection of E -mode polarization around CMB hot and cold spots is shown graphically.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

Recording the synchrotron radiation by a picosecond streak camera for bunch diagnostics in cyclic accelerators

A PS-1/S1 picosecond streak camera with a linear sweep is used to measure temporal characteristics of synchrotron radiation pulses on a damping ring (DR) at the Budker Institute of Nuclear Physics (BINP) of the Siberian Branch of the Russian Academy of Sciences (Novosibirsk). The data obtained allow a conclusion as to the formation processes of electron bunches and their 'quality' in the DR after injection from the linear accelerator. The expediency of employing the streak camera as a part of an optical diagnostic accelerator complex for adjusting the injection from a linear accelerator is shown. Discussed is the issue of designing a new-generation dissector with a time resolution up to a few picoseconds, which would allow implementation of a continuous bunch monitoring in the DR during mutual work with the electron-positron colliders at the BINP. (acoustooptics)

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Addressing Limitations of the Endpoint Slippage Analysis

Some rate of oxidation and reduction side-reactions will inevitably coexist in most rechargeable batteries. While parasitic reduction traps electrons, parasitic oxidation donates electrons to the cell’s inventory and may cause temporary capacity gain. Consequently, capacity measurements can provide unreliable information about the total extent of side-reactions occurring in the cell. The most widely used method to determine the rate of both these parasitic processes involves analyzing the slippage of endpoints, which consists in tracking the termination of cell charge and discharge when data is represented along a cumulative capacity axis. Here, we argue that this approach could lead to inaccuracies when applied to certain systems, which includes Si electrodes in Li-ion batteries and hard carbon in Na-ion batteries. This inaccuracy originates from the smooth nature of the voltage profiles of these materials at low and high alkali-ion content, causing the termination of charge and discharge to be dictated by voltage changes at both the positive and negative electrodes. We analyze this issue in quantitative terms and propose equations that can provide true rates of parasitic processes from experimental endpoint slippage data. This work shows that, in battery science, well-established analytical approaches may not be directly transferrable to new electrode systems.

25 ENERGY STORAGE↗