Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Neural-network learning of SPOD latent dynamics

Here, we aim to reconstruct the latent space dynamics of high dimensional, quasi-stationary systems using model order reduction via the spectral proper orthogonal decomposition (SPOD). The proposed method is based on three fundamental steps: in the first, once that the mean flow field has been subtracted from the realizations (also referred to as snapshots), we compress the data from a high-dimensional representation to a lower dimensional one by constructing the SPOD latent space; in the second, we build the time-dependent coefficients by projecting the snapshots containing the fluctuations onto the SPOD basis and we learn their evolution in time with the aid of recurrent neural networks; in the third, we reconstruct the high-dimensional data from the learnt lower -dimensional representation. The proposed method is demonstrated on two different test cases, namely, a compressible jet flow, and a geophysical problem known as the Madden-Julian Oscillation. An extensive comparison between SPOD and the equivalent POD-based counterpart is provided and differences between the two approaches are highlighted. The numerical results suggest that the proposed model is able to provide low rank predictions of complex statistically stationary data and to provide insights into the evolution of phenomena characterized by specific range of frequencies. The comparison between POD and SPOD surrogate strategies highlights the need for further work on the characterization of the interplay of error between data reduction techniques and neural network forecasts.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The public health exposome and pregnancy-related mortality in the United States: a high-dimensional computational analysis

Racial inequities in maternal mortality in the U.S. continue to be stark. The 2015–2018, 4-year total population, county-level, pregnancy-related mortality ratio (PRM; deaths per 100,000 live births; National Center for Health Statistics (NCHS), restricted use mortality file) was linked with the Public Health Exposome (PHE). Using data reduction techniques, 1591 variables were extracted from over 62,000 variables for use in this analysis, providing information on the relationships between PRM and the social, health and health care, natural, and built environments. Graph theoretical algorithms and Bayesian analysis were applied to PHE/PRM linked data to identify latent networks. PHE variables most strongly correlated with total population PRM were years of potential life lost and overall life expectancy. Population-level indicators of PRM were overall poverty, smoking, lack of exercise, heat, and lack of adequate access to food. In this high-dimensional analysis, overall life expectancy, poverty indicators, and health behaviors were found to be the strongest predictors of pregnancy-related mortality. This provides strong evidence that maternal death is part of a broader constellation of both similar and unique health behaviors, social determinants and environmental exposures as other causes of death.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Simulating and benchmarking neutron total scattering instrumentation from inception of events to reduced and fitted data

In the design and realization of modern neutron scattering instrumentation, particularly when designing beamline concepts from the ground up, it is desirable to fully benchmark against realistically simulated data. This is especially true for total scattering beamlines, where the future deliverable data is to be analysed in both reciprocal- and real-space representations, and needs must be carefully balanced to ensure sufficient range, resolution and flux of the instrument. An approach to optimize the design of neutron scattering instrumentation via a workflow including ray-tracing simulations, event-based data reduction, heuristic analysis and fitting against realistically simulated spectra is demonstrated here. The case of the DISCOVER beamline concept at the Spallation Neutron Source is used as an example. The results of the calculations are benchmarked through simulation of existing instrumentation and subsequent direct comparison with measured data. Finally, on the basis of the validated models, the ability to explore design characteristics for future beamline concepts or future instrument improvements is demonstrated through the examples of detector tube size and detector layout.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

The S-PLUS Fifth Data Release: Over 4500 Square Degrees of the Southern Sky and a Multicolor View of the Hydra and Antlia Galaxy Clusters

Abstract We present the fifth data release (DR5) of the Southern Photometric Local Universe Survey (S-PLUS), covering 4592 deg 2 across 2491 fields. Observations were conducted with the T80-South, a Brazilian robotic telescope equipped with the Javalambre 12-filter system, containing five broadband and seven narrowband filters. Data products feature FITS images and extensive catalogs containing fluxes, magnitudes, and shape parameters for over 113 million detections. In addition, several value-added catalogs are provided, offering photometric redshifts (photo- zs ), object classifications, masks, and extinction coefficients. For the first time, this release includes coverage of 110 deg 2 along the Galactic disk, facilitating new research into Galactic structure and stellar populations. The release also provides full coverage of the Hydra Supercluster and numerous other nearby clusters with improved data reduction and calibration, enhancing photo- z accuracy, which is vital for large-scale structure studies. A preliminary analysis of the Hydra and Antlia galaxy clusters up to 5 × R 200 yields an updated catalog of 1706 cluster members based on both spectroscopic and high-quality photo- zs . Our photometric data shows that both clusters have a similar proportion of galaxies with an H α excess relative to their clustercentric distance, though Hydra has a higher fraction near its center. Additionally, the spatial distribution of all objects in our sample highlights a bridge connecting both clusters. We verify that S-PLUS DR5 provides a solid foundation for future scientific investigations, ranging from solar system studies to cosmology.

Vinicius Rodrigues de Lima, Erik [Universidade de ↗
DOE OSTI2025

Development of Parameters for the Particle Size Distribution of TATB

Laser light scattering (LLS), manual counting of scanning electron microscopy (SEM) images, and reduction of SEM images using ImageJ (open source program) to determine Feret (caliper) diameters were applied to determine particle size distribution (PSD) of four preparations of 1,3,5‐triamino‐2,4,6‐trinitrobenzene (TATB) and yttria‐stabilized zirconia (YSZ), an SEM certified standard. Mie theory was used to reduce the LLS data. The spherical nature of the YSZ made it a good candidate for LLS. Variations in n , the refractive index, and iκ, the imaginary component, produced very little change in the PSD. However, changing the carrier liquid from H 2 O to a 40% aqueous sucrose solution, thereby changing the carrier refractive index, n 0 , substantially affected the PSD. The Mie complex refractive indices for the YSZ were n = 2.200, iκ = 0.100, with a 40% aqueous sucrose solution, n 0 = 1.400. The triclinic crystal structure of TATB made refractive index determinations more difficult, so a study was conducted varying Mie parameters and comparing them to the same data reduced using the Fraunhofer theory. Changing the n and κ parameters produced PSD with a small concentration of particles less than 1 µm in size or none in this range. SEM images, Feret data, manual counting, and Fraunhofer data reduction indicate particles less than 1 µm are probably < 5% in concentration. The final selection of Mie parameters for TATB was n = 2.283, iκ = 0.1, and suspension medium, n 0 = 1.330. Finally, computations, using density functional theory produced similar parameters.

Feret diameter↗
DOE OSTI2025

In-pixel integration of signal processing and AI/ML based data filtering for particle tracking detectors

We present the first physical realization of in-pixel signal processing with integrated AI-based data filtering for particle tracking detectors. Building on prior work that demonstrated a physics-motivated edge-AI algorithm suitable for ASIC implementation, this work marks a significant milestone toward intelligent silicon trackers. Our prototype readout chip performs real-time data reduction at the sensor level while meeting stringent requirements on power, area, and latency. The chip is taped-out in 28nm TSMC CMOS bulk process, which has been shown to have sufficient radiation hardness for particle experiments. This development represents a key step toward enabling fully on-detector edge AI, with broad implications for data throughput and discovery potential in high-rate, high-radiation environments such as the High-Luminosity LHC.

Parpillon, Benjamin [Fermilab; Illinois U., Chicag↗
DOE OSTI2022

Thermal Neutron Cross Section Measurements at the RPI LINAC [Slides]

Cold polyethylene shows adequate capacity for enhancing sub-thermal neutron flux. Cold moderator system produced high quality thermal cross section measurements. Measurements were performed for polyethylene, polystyrene, Plexiglas, yttrium hydride and beryllium and compared with ENDF/B-VIII.0 TSL evaluations. All data reduction for all measurements was finalized. Future work includes completion of necessary journal publications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Combined $\mathrm{APOGEE}$-$\mathrm{GALAH}$ stellar catalogues using the Cannon

APOGEE and GALAH are two high resolution multi-object spectroscopic surveys that provide fundamental stellar parameters and multiple elemental abundance estimates for about half a million stars in the Milky Way. Both surveys observe in different wavelength regimes and use different data reduction pipelines leading to significant offsets and trends in stellar parameters and abundances for the common stars observed in both surveys. Such systematic differences/offsets in stellar parameters and abundances make it difficult to effectively utilize them to investigate Galactic abundance trends in spite of the unique advantage provided by their complementary sky coverage and different Milky Way components they observe. Hence, we use the Cannon data-driven method selecting a training set of 4418 common stars observed by both surveys. This enables the construction of two catalogues, one with the APOGEE-scaled and the other with the GALAH-scaled stellar parameters. Using repeat observations in APOGEE and GALAH, we find high precision in metallicity (~0.02–0.4 dex) and alpha abundances (~0.02–0.03 dex) for spectra with good signal-to-noise ratio (SNR >; 80 for APOGEE and SNR > 40 for GALAH). We use open and globular clusters to validate our parameter estimates and find small scatter in metallicity (0.06 dex) and alpha abundances (0.03 dex) in APOGEE-scaled case. The final catalogues have been cross-matched with the Gaia EDR3 catalogue to enable their use to carry out detailed chemo-dynamic studies of the Milky Way from perspectives of APOGEE and GALAH.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

tobac v1.5: introducing fast 3D tracking, splits and mergers, and other enhancements for identifying and analysing meteorological phenomena

There is a continuously increasing need for reliable feature detection and tracking tools based on objective analysis principles for use with meteorological data. Many tools have been developed over the previous 2 decades that attempt to address this need but most have limitations on the type of data they can be used with, feature computational and/or memory expenses that make them unwieldy with larger datasets, or require some form of data reduction prior to use that limits the tool's utility. The Tracking and Object-Based Analysis of Clouds (tobac) Python package is a modular, open-source tool that improves on the overall generality and utility of past tools. A number of scientific improvements (three spatial dimensions, splits and mergers of features, an internal spectral filtering tool) and procedural enhancements (increased computational efficiency, internal regridding of data, and treatments for periodic boundary conditions) have been included in tobac as a part of the tobac v1.5 update. These improvements have made tobac one of the most robust, powerful, and flexible identification and tracking tools in our field to date and expand its potential use in other fields. Future plans for tobac v2 are also discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Deep Hierarchical Super Resolution for Scientific Data

We present a novel technique for hierarchical super resolution (SR) with neural networks (NNs), which upscales volumetric data represented with an octree data structure to a high-resolution uniform gridwith minimal seam artifacts on octree node boundaries. Our method uses existing state-of-the-art SR models and adds flexibility to upscale input data with varying levels of detail across the domain, instead of only uniform grid data that are supported in previous approaches.The key is to use a hierarchy of SR NNs, each trained to perform 2x SR between two levels of detail, with a hierarchical SR algorithm that minimizes seam artifacts by starting from the coarsest level of detail and working up.We show that our hierarchical approach outperforms baseline interpolation and hierarchical upscaling methods, and demonstrate the usefulness of our proposed approach across three use cases including data reduction using hierarchical downsampling+SR instead of uniform downsampling+SR, computation savings for hierarchical finite-time Lyapunov exponent field calculation, and super-resolving low-resolution simulation results for a high-resolution approximation visualization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Room Temperature Quasi-static Characterization and Constitutive Model Parametrization of Flexible Polyurethane Foams of Different Densities Loaded in Different Orientations

This report describes the efforts to characterize and model General Plastics TF6070 and EF4000 flexible polyurethane foams under room temperature, large deformation quasi-static cyclic mechanical loading conditions. Densities from three to fifteen pound per cubic foot (PCF) are examined, which correspond to relative densities of approximately 4 to 20%. These foams are open cell structured and flexible at room temperature with a glass transition transition less than -30°C, and they fully recover their original shape when unloaded (at room temperature). Uniaxial compression tests were conducted with accompanying lateral image series for Digital Image Correlation (DIC) analysis with the goal of extracting transverse strain responses. Due to difficulties with DIC analysis at large strains, lateral strains were instead extracted for each test via edge tracking. The experimental results exhibit a nonlinear elastic response and anisotropic material behavior (particularly for the lower densities). Some hysteresis is observed that is different between the first and subsequent cycles of deformation indicating both a small degree of permanent damage (reduced stiffness during reloading) and viscoelasticity. These inelastic mechanisms are not considered in the modeling and calibration in this report. This work considers only the rate independent, room temperature foam behavior. Individual foam densities were calibrated for loading in two directions, parallel and perpendicular to the foam bubble rise direction, since the mechanical behavior is different in these two directions. The Flex Foam constitutive model was used for all parameterizations despite the fact that the model is isotropic. A review of the constitutive model is given as well as necessary data reduction procedures to parameterize it for each foam density and orientation are discussed. Finally, two different parameterizations are developed that take the undeformed foam density as an input that span all densities considered. These two parameterized models represent foams loaded in the rise and transverse directions respectively. We summarize the assumptions and limitations of the parameterizations provided in this report to guide analysis choices with them. All parameterizations presented herein have the following traits, room temperature, rate independent, damage-free, and non-dissipative . Isotropy (even if they are representing anisotropic data). Supplied Sierra Solid Mechanics Flex Foam Model Inputs are in units: pounds, inches, Celsius, and seconds

36 MATERIALS SCIENCE↗
DOE OSTI2026

Machine Learning on Heterogeneous, Edge, and Quantum Hardware for Particle Physics (ML-HEQUPP)

The next generation of particle physics experiments will face a new era of challenges in data acquisition, due to unprecedented data rates and volumes along with extreme environments and operational constraints. Harnessing this data for scientific discovery demands real-time inference and decision-making, intelligent data reduction, and efficient processing architectures beyond current capabilities. Crucial to the success of this experimental paradigm are several emerging technologies, such as artificial intelligence and machine learning (AI/ML) and silicon microelectronics, and the advent of quantum algorithms and processing. Their intersection includes areas of research such as low-power and low-latency devices for edge computing, heterogeneous accelerator systems, reconfigurable hardware, novel codesign and synthesis strategies, readout for cryogenic or high-radiation environments, and analog computing. This white paper presents a community-driven vision to identify and prioritize research and development opportunities in hardware-based ML systems and corresponding physics applications, contributing towards a successful transition to the new data frontier of fundamental science.

Gonski, Julia [SLAC]↗
DOE OSTI2025

A 28 nm multiply-accumulate ASIC architecture for on-chip data compression in MHz frame rate X-ray and electron pixel detectors

Modern X-ray detector systems urgently require compact, efficient, and fast data compression schemes to handle the transmission of big data from pixel arrays, enabling frame rates in the MHz regime. Here, in this work, a data compression ASIC that implements a streaming fixed-length lossy compression scheme is introduced and analyzed, proving the feasibility and benefits of on-chip compression. The compression scheme utilizes a vector matrix product logic, which performs a number of floating-point multiplications, additions, and accumulations. The logic is verified, synthesized, and shown to fit in the area resource available for the X-ray detector under study, which comprises 192 × 168 pixels each of 12-bit width, and having a total area of 20 mm× 20 mm, about 2 mm× 20 mm of which are available for the digital logic. Several system architectures, precisions, and compression ratios ranging from 100 to 250 were analyzed to pave the way for on-chip fixed-length compression (e.g., principal component analysis, singular value decomposition) and data reduction (e.g., azimuthal integration) for X-ray and electron detectors.

Data compression↗
DOE OSTI2022

Mapping structural heterogeneity at the nanoscale with scanning nano-structure electron microscopy (SNEM)

Here, in this work, we explore the use of scanning electron diffraction (also known as 4D-STEM) coupled with electron atomic pair distribution function analysis (ePDF) to understand the local order (structure and chemistry) as a function of position in a complex multicomponent system, a hot rolled, Ni-encapsulated, Zr 65 Cu 17.5 Ni 10 Al 7.5 bulk metallic glass (BMG), with a spatial resolution of 3 nm. We show that it is possible to gain insight into the chemistry and chemical clustering/ordering tendency in different regions of the sample, including in the vicinity of nano-scale crystallites that are identified from virtual dark field images and in heavily deformed regions at the edge of the BMG. In addition to simpler analysis, unsupervised machine learning was used to extract partial PDFs from the material, modeled as a quasi-binary alloy, and map them in space. These maps allowed key insights not only into the local average composition, as validated by EELS, but also a unique insight into chemical short-range ordering tendencies in different regions of the sample during formation. The experiments are straightforward and rapid and, unlike spectroscopic measurements, don’t require energy filters on the instrument. We spatially map different quantities of interest (QoI’s), defined as scalars that can be computed directly from positions and widths of ePDF peaks or parameters refined from fits to the patterns. We developed a flexible and rapid data reduction and analysis software framework that allows experimenters to rapidly explore images of the sample on the basis of different QoI’s. The power and flexibility of this approach are explored and described in detail. Because of the fact that we are getting spatially resolved images of the nanoscale structure obtained from ePDFs we call this approach scanning nano-structure electron microscopy (SNEM), and we believe that it will be powerful and useful extension of current 4D-STEM methods.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Detailed in situ ATR-FTIR spectroscopy study of the early stages of C-S-H formation during hydration of monoclinic C3S

The early stages of tricalcium silicate hydration has been studied by in situ ATR-FTIR spectroscopy. A method for data reduction based on background correction and subtraction of spectra of pure components is presented, which makes it possible to describe the kinetic evolution of the calcium silicate hydrate phase upon hydration with great detail. The results obtained are in full agreement with recently reported, detailed solid-state NMR spectroscopy measurements. As ATR-FTIR spectroscopy does not require any isotope enrichment in order to increase the signal intensities and is a widely available technique, we suggest that our study opens up an avenue towards detailed in situ characterization of hydrating cementitious systems and hydrating systems in general.

36 MATERIALS SCIENCE↗
DOE OSTI2026

ClassNMSW- a real-time classification approach for non-recycled municipal solid waste using hyperspectral imaging

Real-time classification of non-recycled municipal solid waste (NMSW) is essential for efficient valorization. This study introduces ClassNMSW, a comprehensive framework for classifying 22 NMSW subclasses under industrial constraints by using hyperspectral imaging (HSI). A primary innovation of this work is the development of a variance-controlled spectral extraction algorithm. Unlike traditional methods that rely on simple averaging, this approach systematically investigates the extent of pixel extraction to minimize the loss of critical chemical information while maximizing data reduction thus ensuring high spectral fidelity with low computational cost. The approach developed in this work integrates automated, computer-vision-based background removal, eliminating the need for the manual thresholding common in current literature. To resolve ambiguities among chemically similar subclasses, a tiered classification and multi-camera fusion strategy (NIR17 and NIR22) is implemented. Results demonstrate that ClassNMSW achieves an object-wise weighted accuracy of 98.70% for single-sensor configurations and 100% under sensor fusion. A novel rolling-window strategy satisfies desired end-to-end latency of <2 s, satisfying the strict deterministic requirements of high-speed industrial sorting environments. The ClassNMSW framework provides a scalable foundation for advancing circularity and resource recovery in large-scale waste valorization operations.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Wire-coil insert optimization for high-heat-load/flux synchrotron components

Many synchrotron components require high levels of internal-flow, forced-convection heat transfer to minimize surface temperatures, thermal gradients, and thermally induced stress on high-power beam-interacting surfaces. Wire-coil inserts, physically similar to a common spring, are mechanically fitted inside of component cooling passages to optimize heat transfer performance. They are routinely used in Advanced Photon Source (APS) front end and beamline high-heat-load/flux components to significantly enhance convection heat transfer-up to 400% compared to plain open passages. This has the additional benefit of greatly reducing coolant flow requirements for these components. Using several cooling passage sizes, five different wire sizes, and a range of pitch values, an experimental investigation conducted at the APS has determined the average heat transfer coefficient and resulting pressure loss as a function of water flow rate for 65 different wire-coil inserts. Data from this study have been non-dimensionalized and generalized to yield relationships that can be used to determine the heat transfer performance and resulting pressure loss for any given wire-coil insert that may be used at the APS. Through data reduction, the wire-coil insert characteristic dimensions have also been optimized to yield the highest heat transfer enhancement while minimizing the coolant flow requirements. These generalized expressions for wirecoil inserts will be presented, and they can be used by scientists and engineers during the component design process to evaluate achievable heat transfer performance and associated pressure loss, aiding in the establishment of optimized operating parameters and cooling passage flow distribution schemes.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Investigating Quantum Materials with Half-Polarized Diffraction and magnetic PDF analysis at the HB-2A Neutron Powder Diffractometer

Local magnetic ordering and anisotropy is often central to the emergent behavior and subsequent functional properties in quantum materials and beyond. Neutron powder diffraction provides a straightforward yet extremely powerful technique for quantitative measurements of microscopic magnetic properties. The HB-2A powder diffractometer located at the High Flux Isotope Reactor in ORNL is traditionally utilized for long-range magnetic structure determination. Recently these capabilities have been extended to include methods aimed at accessing local magnetism: Half- polarized neutron powder diffraction (pNPD) and magnetic pair distribution function (mPDF) analysis. These two distinct techniques are possible on HB-2A due to the versatility of the instrument’s reciprocal space coverage, resolution and novel ultra-low temperature multi-sample changers that operate down to dilution refrigerator temperatures. This provides unique capabilities not found on any powder diffraction instrument and is particularly well suited to investigations of magnetic quantum materials. The development and implementation of these techniques will be discussed with a series of science case examples ranging from geometric frustrated magnets to magnetic metal-organic frameworks. Data reduction and analysis tools will be presented that enable the extraction of the local site susceptibility tensor and local spin-spin correlations in real space. Finally, potential combinations of these techniques in the form of half-polarized magnetic pair distribution function (pmPDF) analysis will be considered. Looking forward, HB-2A is undergoing a detector upgrade that will be in the user program by 2026. This will offer an order of magnitude increase in count rates to further aid the development of these often low signal measurements and provide new scientific capabilities.

Neutron Scattering↗