Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The Sixth Data Release of the Radial Velocity Experiment (RAVE). I. Survey Description, Spectra, and Radial Velocities

The Radial Velocity Experiment (Rave) is a magnitude-limited (9 < I < 12) spectroscopic survey of Galactic stars randomly selected in Earth’s southern hemisphere. The Rave medium-resolution spectra (R ~ 7500) cover the Ca-triplet region (8410–8795 Å). The sixth and final data release (DR6) is based on 518,387 observations of 451,783 unique stars. Rave observations were taken between 2003 April 12 and 2013 April 4. Here we present the genesis, setup, and data reduction of Rave as well as wavelength-calibrated and flux-normalized spectra and error spectra for all observations in Rave DR6. Furthermore, we present derived spectral classification and radial velocities for the Rave targets, complemented by cross-matches with Gaia DR2 and other relevant catalogs. A comparison between internal error estimates, variances derived from stars with more than one observing epoch, and a comparison with radial velocities of Gaia DR2 reveals consistently that 68% of the objects have a velocity accuracy better than 1.4 km s{sup –1}, while 95% of the objects have radial velocities better than 4.0 km s{sup –1}. Stellar atmospheric parameters, abundances and distances are presented in a subsequent publication. The data can be accessed via the Rave website (http://rave-survey.org) or the Vizier database.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

A 28 nm multiply-accumulate ASIC architecture for on-chip data compression in MHz frame rate X-ray and electron pixel detectors

Modern X-ray detector systems urgently require compact, efficient, and fast data compression schemes to handle the transmission of big data from pixel arrays, enabling frame rates in the MHz regime. Here, in this work, a data compression ASIC that implements a streaming fixed-length lossy compression scheme is introduced and analyzed, proving the feasibility and benefits of on-chip compression. The compression scheme utilizes a vector matrix product logic, which performs a number of floating-point multiplications, additions, and accumulations. The logic is verified, synthesized, and shown to fit in the area resource available for the X-ray detector under study, which comprises 192 × 168 pixels each of 12-bit width, and having a total area of 20 mm× 20 mm, about 2 mm× 20 mm of which are available for the digital logic. Several system architectures, precisions, and compression ratios ranging from 100 to 250 were analyzed to pave the way for on-chip fixed-length compression (e.g., principal component analysis, singular value decomposition) and data reduction (e.g., azimuthal integration) for X-ray and electron detectors.

Data compression↗
DOE OSTI2020

Hypergraph Analytics of Domain Name System Relationships

We report on the use of novel mathematical methods in hypergraph analytice over a large quantity of DNS data. Hypergraphs generalize graphs, as used in network science, to better model complex multiway relations in cyber data. Specifically, casting DNS data from Georgia Tech's ActiveDNS repository as hypergraphs allows us to fully represent the interactions between {\em collections} of domains and IP addresses. To facilitate large-scale analytics, we fielded an analytical pipeline of two capabilities. HyperNetX (HNX) is a Python package for the exploration and visualization of hypergraphs, acting as a frontend. For the backend, the Chapel HyperGraph Library (CHGL) is a library for high performance hypergraph analytics written in the exascale programming language Chapel. CHGL was used to process gigascale DNS data, performing compute-intensive calculations for data reduction and segmentation. Identified portions are then sent to HNX for both exploratory analysis and knowledge discovery targeting known tactics, techniques, and procedures.

Joslyn, Cliff A.↗
DOE OSTI2022

Mapping structural heterogeneity at the nanoscale with scanning nano-structure electron microscopy (SNEM)

Here, in this work, we explore the use of scanning electron diffraction (also known as 4D-STEM) coupled with electron atomic pair distribution function analysis (ePDF) to understand the local order (structure and chemistry) as a function of position in a complex multicomponent system, a hot rolled, Ni-encapsulated, Zr 65 Cu 17.5 Ni 10 Al 7.5 bulk metallic glass (BMG), with a spatial resolution of 3 nm. We show that it is possible to gain insight into the chemistry and chemical clustering/ordering tendency in different regions of the sample, including in the vicinity of nano-scale crystallites that are identified from virtual dark field images and in heavily deformed regions at the edge of the BMG. In addition to simpler analysis, unsupervised machine learning was used to extract partial PDFs from the material, modeled as a quasi-binary alloy, and map them in space. These maps allowed key insights not only into the local average composition, as validated by EELS, but also a unique insight into chemical short-range ordering tendencies in different regions of the sample during formation. The experiments are straightforward and rapid and, unlike spectroscopic measurements, don’t require energy filters on the instrument. We spatially map different quantities of interest (QoI’s), defined as scalars that can be computed directly from positions and widths of ePDF peaks or parameters refined from fits to the patterns. We developed a flexible and rapid data reduction and analysis software framework that allows experimenters to rapidly explore images of the sample on the basis of different QoI’s. The power and flexibility of this approach are explored and described in detail. Because of the fact that we are getting spatially resolved images of the nanoscale structure obtained from ePDFs we call this approach scanning nano-structure electron microscopy (SNEM), and we believe that it will be powerful and useful extension of current 4D-STEM methods.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Detailed in situ ATR-FTIR spectroscopy study of the early stages of C-S-H formation during hydration of monoclinic C3S

The early stages of tricalcium silicate hydration has been studied by in situ ATR-FTIR spectroscopy. A method for data reduction based on background correction and subtraction of spectra of pure components is presented, which makes it possible to describe the kinetic evolution of the calcium silicate hydrate phase upon hydration with great detail. The results obtained are in full agreement with recently reported, detailed solid-state NMR spectroscopy measurements. As ATR-FTIR spectroscopy does not require any isotope enrichment in order to increase the signal intensities and is a widely available technique, we suggest that our study opens up an avenue towards detailed in situ characterization of hydrating cementitious systems and hydrating systems in general.

36 MATERIALS SCIENCE↗
DOE OSTI2026

ClassNMSW- a real-time classification approach for non-recycled municipal solid waste using hyperspectral imaging

Real-time classification of non-recycled municipal solid waste (NMSW) is essential for efficient valorization. This study introduces ClassNMSW, a comprehensive framework for classifying 22 NMSW subclasses under industrial constraints by using hyperspectral imaging (HSI). A primary innovation of this work is the development of a variance-controlled spectral extraction algorithm. Unlike traditional methods that rely on simple averaging, this approach systematically investigates the extent of pixel extraction to minimize the loss of critical chemical information while maximizing data reduction thus ensuring high spectral fidelity with low computational cost. The approach developed in this work integrates automated, computer-vision-based background removal, eliminating the need for the manual thresholding common in current literature. To resolve ambiguities among chemically similar subclasses, a tiered classification and multi-camera fusion strategy (NIR17 and NIR22) is implemented. Results demonstrate that ClassNMSW achieves an object-wise weighted accuracy of 98.70% for single-sensor configurations and 100% under sensor fusion. A novel rolling-window strategy satisfies desired end-to-end latency of <2 s, satisfying the strict deterministic requirements of high-speed industrial sorting environments. The ClassNMSW framework provides a scalable foundation for advancing circularity and resource recovery in large-scale waste valorization operations.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Wire-coil insert optimization for high-heat-load/flux synchrotron components

Many synchrotron components require high levels of internal-flow, forced-convection heat transfer to minimize surface temperatures, thermal gradients, and thermally induced stress on high-power beam-interacting surfaces. Wire-coil inserts, physically similar to a common spring, are mechanically fitted inside of component cooling passages to optimize heat transfer performance. They are routinely used in Advanced Photon Source (APS) front end and beamline high-heat-load/flux components to significantly enhance convection heat transfer-up to 400% compared to plain open passages. This has the additional benefit of greatly reducing coolant flow requirements for these components. Using several cooling passage sizes, five different wire sizes, and a range of pitch values, an experimental investigation conducted at the APS has determined the average heat transfer coefficient and resulting pressure loss as a function of water flow rate for 65 different wire-coil inserts. Data from this study have been non-dimensionalized and generalized to yield relationships that can be used to determine the heat transfer performance and resulting pressure loss for any given wire-coil insert that may be used at the APS. Through data reduction, the wire-coil insert characteristic dimensions have also been optimized to yield the highest heat transfer enhancement while minimizing the coolant flow requirements. These generalized expressions for wirecoil inserts will be presented, and they can be used by scientists and engineers during the component design process to evaluate achievable heat transfer performance and associated pressure loss, aiding in the establishment of optimized operating parameters and cooling passage flow distribution schemes.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Investigating Quantum Materials with Half-Polarized Diffraction and magnetic PDF analysis at the HB-2A Neutron Powder Diffractometer

Local magnetic ordering and anisotropy is often central to the emergent behavior and subsequent functional properties in quantum materials and beyond. Neutron powder diffraction provides a straightforward yet extremely powerful technique for quantitative measurements of microscopic magnetic properties. The HB-2A powder diffractometer located at the High Flux Isotope Reactor in ORNL is traditionally utilized for long-range magnetic structure determination. Recently these capabilities have been extended to include methods aimed at accessing local magnetism: Half- polarized neutron powder diffraction (pNPD) and magnetic pair distribution function (mPDF) analysis. These two distinct techniques are possible on HB-2A due to the versatility of the instrument’s reciprocal space coverage, resolution and novel ultra-low temperature multi-sample changers that operate down to dilution refrigerator temperatures. This provides unique capabilities not found on any powder diffraction instrument and is particularly well suited to investigations of magnetic quantum materials. The development and implementation of these techniques will be discussed with a series of science case examples ranging from geometric frustrated magnets to magnetic metal-organic frameworks. Data reduction and analysis tools will be presented that enable the extraction of the local site susceptibility tensor and local spin-spin correlations in real space. Finally, potential combinations of these techniques in the form of half-polarized magnetic pair distribution function (pmPDF) analysis will be considered. Looking forward, HB-2A is undergoing a detector upgrade that will be in the user program by 2026. This will offer an order of magnitude increase in count rates to further aid the development of these often low signal measurements and provide new scientific capabilities.

Neutron Scattering↗
DOE OSTI2025

Bayesian inference of anisotropic 2D small-angle scattering from sparse measurement

Here, we present a Bayesian inference framework for reconstructing anisotropic two-dimensional small-angle scattering (2D SAS) patterns from sparse, noisy, or partially missing data. The method combines a symmetry-aware angular basis with radial Gaussian process priors to enable accurate, training-free interpolation and denoising. Computational benchmarks demonstrate reliable recovery of both isotropic and high-order anisotropic features under severe data reduction. Experimental validations on stretched polymers, sheared wormlike micelles, and carbon fibers show improved fidelity and resolution compared to raw measurements, achieving comparable accuracy with up to 50-fold fewer detected neutrons. This approach enables quantitative structural analysis under low-flux, time-limited, or single-shot conditions, extending the applicability of 2D SAS techniques to compact neutron sources and mechanically driven soft matter systems undergoing transient structural changes.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗
DOE OSTI2025

Simulations of Heat Transfer Using Tight-Fitting Twisted Tape Inserts for First Wall Cooling in Molten Salt Breeder Blankets

One of the major components in fusion energy systems is the fusion blanket, which has a vacuum vessel to contain the plasma. As part of the fusion blanket/vacuum vessel, the first wall and plasma-facing components require sufficient cooling to prevent material degradation during operation from the superheated plasma. Most fusion blanket concepts involve first wall and divertor coolant channels with heat transfer enhancements (HTEs) that are intended to withstand the incident high heat fluxes of 1 to 5 MW/m 2 . Twisted tape inserts are a proposed HTE that have been investigated previously for first wall cooling and monoblock divertor cooling channels and in other nonfusion heat transfer components. By inserting twisted tapes into straight pipes, the amount of turbulence in the system can be increased at lower Reynolds numbers by swirling the flow. This results in better heat transfer characteristics with marginal increases in frictional pressure losses. In particular, simulations of high-Prandtl-number fluids such as the proposed molten salt FLiBe in twisted tapes, which is prototypic to liquid immersion blankets, have not been previously explored. Here, in this study, we simulate various Prandtl numbers in pipes with twisted tape inserts using large eddy simulations to determine the effects of increasing Prandtl numbers on heat transfer performance. The quantities of particular interest are the Nusselt number and the friction factor, which were recovered using data reduction techniques to determine impacts on heat transfer and pressure losses. This work serves as a starting point for determining the feasibility of twisted tape inserts for liquid immersion blanket concepts.

LES↗
DOE OSTI2025

The Simons Observatory: science goals and forecasts for the enhanced Large Aperture Telescope

We describe updated scientific goals for the wide-field, millimeter-wave survey that will be produced by the Simons Observatory (SO). Significant upgrades to the 6-meter SO Large Aperture Telescope (LAT) are expected to be complete by 2028, and will include a doubled mapping speed with 30,000 new detectors and an automated data reduction pipeline. In addition, a new photovoltaic array will supply most of the observatory's power. The LAT survey will cover about 60% of the sky at a regular observing cadence, with five times the angular resolution and ten times the map depth of the Planck satellite. The science goals are to: (1) determine the physical conditions in the early universe and constrain the existence of new light particles; (2) measure the integrated distribution of mass, electron pressure, and electron momentum in the late-time universe, and, in combination with optical surveys, determine the neutrino mass and the effects of dark energy via tomographic measurements of the growth of structure at redshifts z ≲ 3; (3) measure the distribution of electron density and pressure around galaxy groups and clusters, and calibrate the effects of energy input from galaxy formation on the surrounding environment; (4) produce a sample of more than 30,000 galaxy clusters, and more than 100,000 extragalactic millimeter sources, including regularly sampled AGN light-curves, to study these sources and their emission physics; (5) measure the polarized emission from magnetically aligned dust grains in our Galaxy, to study the properties of dust and the role of magnetic fields in star formation; (6) constrain asteroid regoliths, search for Trans-Neptunian Objects, and either detect or eliminate large portions of the phase space in the search for Planet 9; and (7) provide a powerful new window into the transient universe on time scales of minutes to years, concurrent with observations from the Vera C. Rubin Observatory of overlapping sky.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

The Spectroscopic Classification of Astronomical Transients (SCAT) Survey: Overview, Pipeline Description, Initial Results, and Future Plans

Here, we present the Spectroscopic Classification of Astronomical Transients (SCAT) survey, which is dedicated to spectrophotometric observations of transient objects such as supernovae and tidal disruption events. SCAT uses the SuperNova Integral-Field Spectrograph (SNIFS) on the University of Hawai’i 2.2 m (UH2.2m) telescope. SNIFS was designed specifically for accurate transient spectrophotometry, including absolute flux calibration and host-galaxy removal. We describe the data reduction and calibration pipeline including spectral extraction, telluric correction, atmospheric characterization, nightly photometricity, and spectrophotometric precision. We achieve ≲5% spectrophotometry across the full optical wavelength range (3500–9000 Å) under photometric conditions. The inclusion of photometry from the SNIFS multi-filter mosaic imager allows for decent spectrophotometric calibration (10%–20%) even under unfavorable weather/atmospheric conditions. SCAT obtained ≈640 spectra of transients over the first 3 yr of operations, including supernovae of all types, active galactic nuclei, cataclysmic variables, and rare transients such as superluminous supernovae and tidal disruption events. These observations will provide the community with benchmark spectrophotometry to constrain the next generation of hydrodynamic and radiative transfer models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Keck Infrared Transient Survey. I. Survey Description and Data Release 1

Abstract We present the Keck Infrared Transient Survey, a NASA Key Strategic Mission Support program to obtain near-infrared (NIR) spectra of astrophysical transients of all types, and its first data release, consisting of 105 NIR spectra of 50 transients. Such a data set is essential as we enter a new era of IR astronomy with the James Webb Space Telescope (JWST) and the upcoming Nancy Grace Roman Space Telescope (Roman). NIR spectral templates will be essential to search JWST images for stellar explosions of the first stars and to plan an effective Roman SN Ia cosmology survey, both key science objectives for mission success. Between 2022 February and 2023 July, we systematically obtained 274 NIR spectra of 146 astronomical transients, representing a significant increase in the number of available NIR spectra in the literature. Here, we describe the first release of data from the 2022A semester. We systematically observed three samples: a flux-limited sample that includes all transients <17 mag in a red optical band (usually ZTF r or ATLAS o bands); a volume-limited sample including all transients within redshift z < 0.01 ( D ≈ 50 Mpc); and an SN Ia sample targeting objects at phases and light-curve parameters that had scant existing NIR data in the literature. The flux-limited sample is 39% complete (60% excluding SNe Ia), while the volume-limited sample is 54% complete and is 79% complete to z = 0.005. Transient classes observed include common Type Ia and core-collapse supernovae, tidal disruption events, luminous red novae, and the newly categorized hydrogen-free/helium-poor interacting Type Icn supernovae. We describe our observing procedures and data reduction using PypeIt , which requires minimal human interaction to ensure reproducibility.

Tinyanont, S. (ORCID:0000000214814676)↗
DOE OSTI2024

Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning

Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High- Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of $\mathcal{O}$(40 MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 57.1%–75.7%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 μW with an area of less than 0.2 mm 2 . The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

SHαDE: survey description and mass–kinematics scaling relations for dwarf galaxies

ABSTRACT The Study of H α from Dwarf Emissions (SHαDE) is a high spectral resolution (R = 13 500) H α integral field survey of 69 dwarf galaxies with stellar masses 106 < M⋆ < 109 M⊙. The survey used FLAMES on the ESO Very Large Telescope. SHαDE is designed to study the kinematics and stellar populations of dwarf galaxies using consistent methods applied to massive galaxies and at matching level of detail, connecting these mass ranges in an unbiased way. In this paper, we set out the science goals of SHαDE, describe the sample properties, outline the data reduction, and analysis processes. We investigate the log M⋆–log S0.5 mass–kinematics scaling relation, which has previously shown potential for combining galaxies of all morphologies in a single scaling relation. We extend the scaling relation from massive galaxies to dwarf galaxies, demonstrating this relation is linear down to a stellar mass of M⋆ ∼ 108.6 M⊙. Below this limit, the kinematics of galaxies inside one effective radius appears to be dominated by the internal velocity dispersion limit of the H α-emitting gas, giving a bend in the log M⋆–log S0.5 relation. Replacing stellar mass with total baryonic mass using gas mass estimate reduces the severity but does not remove the linearity limit of the scaling relation. An extrapolation to estimate the galaxies’ dark matter halo masses, yields a log Mh–log S0.5 scaling relation that is free of any bend, has reduced curvature over the whole mass range, and brings galaxies of all masses and morphologies on to the virial relation.

Barat, Dilyar↗
DOE OSTI2024

Chemical evolution of local post-starburst galaxies: implications for the mass–metallicity relation

ABSTRACT We use the stellar fossil record to constrain the stellar metallicity evolution and star-formation histories of the post-starburst (PSB) regions within 45 local PSB galaxies from the MaNGA survey. The direct measurement of the regions’ stellar metallicity evolution is achieved by a new two-step metallicity model that allows for stellar metallicity to change at the peak of the starburst. We also employ a Gaussian process noise model that accounts for correlated errors introduced by the observational data reduction or inaccuracies in the models. We find that a majority of PSB regions (69 per cent at >1σ significance) increased in stellar metallicity during the recent starburst, with an average increase of 0.8 dex and a standard deviation of 0.4 dex. A much smaller fraction of PSBs are found to have remained constant (22 per cent) or declined in metallicity (9 per cent, average decrease 0.4 dex, standard deviation 0.3 dex). The pre-burst metallicities of the PSB galaxies are in good agreement with the mass–metallicity (MZ) relation of local star-forming galaxies. These results are consistent with hydrodynamic simulations, which suggest that mergers between gas-rich galaxies are the primary formation mechanism of local PSBs, and rapid metal recycling during the starburst outweighs the impact of dilution by any gas inflows. The final mass-weighted metallicities of the PSB galaxies are consistent with the MZ relation of local passive galaxies. Our results suggest that rapid quenching following a merger-driven starburst is entirely consistent with the observed gap between the stellar mass–metallicity relations of local star-forming and passive galaxies.

Leung, Ho-Hin (ORCID:0000000304865178)↗
DOE OSTI2021

Quantitative texture analysis using the NOMAD time-of-flight neutron diffractometer

Strategies for efficient and reliable texture measurements have been explored using the Nanoscale Ordered Materials Diffractometer (NOMAD) at the Spallation Neutron Source located at Oak Ridge National Laboratory (ORNL). To test these strategies, the texture of an Al alloy was also investigated using another neutron diffraction instrument, a constant-wavelength neutron diffractometer (NRSF2) located at the High Flux Isotope Reactor, also at ORNL. Reasonable agreement was found across the two experimental methods, but differences in overall texture strength and the symmetry of some components were noted, depending on the data reduction and analysis method selected. Finally, on the basis of these results, potential improvements are identified which would enhance the texture measurement capability on NOMAD.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Towards scanning nanostructure X-ray microscopy

This article demonstrates spatial mapping of the local and nanoscale structure of thin film objects using spatially resolved pair distribution function (PDF) analysis of synchrotron X-ray diffraction data. This is exemplified in a lab-on-chip combinatorial array of sample spots containing catalytically interesting nanoparticles deposited from liquid precursors using an ink-jet liquid-handling system. A software implementation is presented of the whole protocol, including an approach for automated data acquisition and analysis using the atomic PDF method. The protocol software can handle semi-automated data reduction, normalization and modeling, with user-defined recipes generating a comprehensive collection of metadata and analysis results. By slicing the collection using included functions, it is possible to build images of different contrast features chosen by the user, giving insights into different aspects of the local structure.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗