Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Enabling Command-and-Control in Advanced In Situ Workflows

Scientific discovery is progressing towards autonomous science with the combination of scientific instruments, high-performance computing, and artificial intelligence in complex workflows. This evolution introduces new requirements for managing scientific workflows, including feedback loops, near real-time constraints, and the ability to dynamically control workflow execution. In situ workflows that analyze and visualize data as it is generated are well-suited to satisfy stringent time constraints and their iterative nature offers greater opportunities for command-and-control. However, only a few of the many workflow management systems available have been specifically designed to manage in situ workflows and often lack support for automated feedback loops that allow analysis and visualization components to interact with the main scientific data producer. To address this need, we present in this paper how to add command-and-control capabilities to a workflow management system. We identify the functional design requirements of such a command-and-control system, detail its architecture, interface, and core mechanisms, and illustrate how advanced in situ workflows can leverage command-and-control in three use cases: graceful termination with checkpoint, dynamic and adaptive data reduction, and event-triggered analysis.

Mehta, Kshitij [ORNL] (ORCID:0000000297149981)↗
DOE OSTI2026

pySimpleMask

SF-26-118 pySimpleMask is a tool for creating masks and Q-partition maps for X-ray scattering patterns, supporting SAXS, WAXS, and XPCS data reduction. It ships both a desktop GUI and a headless Python API that can drive the full pipeline from scripts.

Chu, Miaoqi [Argonne National Laboratory (ANL), Ar↗
DOE OSTI2024

ZFP: A compressed array representation for numerical computations

HPC trends favor algorithms and implementations that reduce data motion relative to FLOPS. We investigate the use of lossy compressed data arrays in place of traditional IEEE floating point arrays to store the primary data of calculations. Simulation is fundamentally an exercise in controlled approximation, and error introduced by finite-precision arithmetic (or lossy compression) is just one of several sources of error that need to be managed to ensure sufficient accuracy in a computed result. We describe ZFP, a compressed numerical format designed for in-memory storage of multidimensional arrays, and summarize theoretical results that demonstrate that the error of repeated lossy compression can be bounded and controlled. Furthermore, we establish a relationship between grid resolution and compression-induced errors and show that, contrary to conventional floating point, ZFP reduces finite-difference errors with finer grids. We present example calculations that demonstrate data reduction by 4x or more with negligible impact on solution accuracy. Our results further demonstrate several orders-of-magnitude increase in accuracy using ZFP over IEEE floating point and Posits for the same storage budget.

Lindstrom, Peter↗
DOE OSTI2024

Uncertainty Propagation from Experiment Measurements to Modeling Approaches: A Case for SMR Steam Entrainment Testing

To license new and advanced reactor designs, regulators must be convinced that their unique safety cases—relative to existing large scale reactors—have been adequately addressed by the designed reactor protection systems. In water cooled small modular reactors (SMRs), droplet entrainment in steam flow has significant implications on the progression of accident scenarios due to its compact design features, which requires representative test data applicable to SMR designs. Computer code, modeling and simulation (M&S) tools and models require adequate verification, assessment, and qualification. This includes M&S results validation against scaled empirical data within allowable uncertainty bands to gain regulatory approvals during the various stages of reactor system design, demonstration, and commercialization. However, measurement uncertainty within the empirical datasets and test data applicability ranges requires careful consideration of M&S inputs (i.e., boundary conditions, and initial conditions), and verification and validation efforts. This study focuses on uncertainty quantification in designing scaled test facilities for SMR applications with appropriate measurements and a standard data-reduction method to estimate thermal hydraulics characteristics parameters that incorporate physics phenomena of interest. In addition, this study supports the evaluation model development and assessment process using M&S that interfaces with advanced computing tools and digital twin capabilities. This will allow synchronization between experiment and modeling approaches for droplet entrainment testing and analysis, improving diagnostics, prognostics, and decision-making to accelerate regulatory approval.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Transfer learning for metamaterial design and simulation

Abstract We demonstrate transfer learning as a tool to improve the efficacy of training deep learning models based on residual neural networks (ResNets). Specifically, we examine its use for study of multi-scale electrically large metasurface arrays under open boundary conditions in electromagnetic metamaterials. Our aim is to assess the efficiency of transfer learning across a range of problem domains that vary in their resemblance to the original base problem for which the ResNet model was initially trained. We use a quasi-analytical discrete dipole approximation (DDA) method to simulate electrically large metasurface arrays to obtain ground truth data for training and testing of our deep neural network. Our approach can save significant time for examining novel metasurface designs by harnessing the power of transfer learning, as it effectively mitigates the pervasive data bottleneck issue commonly encountered in deep learning. We demonstrate that for the best case when the transfer task is sufficiently similar to the target task, a new task can be effectively trained using only a few data points yet still achieve a test mean absolute relative error of 3 % with a pre-trained neural network, realizing data reduction by a factor of 1000.

Peng, Rixi↗
DOE OSTI2023

TEAMER: Water Tunnel Data from Testing the Pterofin Skimmer Concept

Pterofin's Skimmer concept relies on a flapping and pitching hydrofoil to extract hydrokinetic energy from water flows. The concept aims to utilize unsteady fluid dynamics phenomena (added mass, shed vorticity, and unsteady boundary layer development) to achieve higher lift coefficients, enabling increased power density of the hydrokinetic device and a fundamental shift in the rpm/torque scaling of the power take off compared with turbines. The Applied Research Laboratory at Penn State, in collaboration with Pterofin, designed and built a proof-of-concept flapping/pitching mechanism which was subsequently tested in ARL's 12-inch water tunnel facility. The mechanical power supplied to or extracted from the mechanism was measured for a range of hydrofoils provided by Pterofin over operating conditions including reduced frequency, Reynolds number, and the ratio between pitching and flapping amplitudes. The power lost to friction in the mechanism was removed from the net power measurement by means of a bare hub tare, with the resultant hydrodynamic power being used to calculate a mechanism-independent and non-dimensional power coefficient. The product of this effort is a dataset describing the power coefficient of a hydrofoil having simultaneous pitching and flapping motions, both of which are approximately sinusoidal. Power coefficients were collected for a range of primary design variables including: - Reduced frequency: 0.01 to 0.95 - Pitching/flapping peak angle ratio: 1.5 to 3.0 - Chord-based Reynolds number: 60,000 to 560,000 Secondary design variables relating to the hydrofoil geometry were explored including: - Aspect ratio - Planform shape - Section thickness distribution - Hydrofoil position relative to the pitching axis - Hydrofoil sweep angle relative to the pitching axis Measured data are provided in mean and time series formats. MATLAB scripts are provided which can be used to generate figures of time-averaged and phase-averaged hydrodynamic power coefficients calculated from the measured data. A complete description of the experiment and data reduction can be found in the Post Access Report for the Pterofin Skimmer test effort which will be available on the TEAMER website. This work was supported by the Pacific Energy Ocean Trust via a TEAMER award.

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

2019 Quantum Materials Young Investigators Workshop Report

The fourth edition of the workshop “Quantum Materials Young Investigators” was held June 6-7, 2019 at the Oak Ridge National Laboratory (ORNL). This workshop followed up on previous meetings that took place at ORNL starting in 2016. This important series of annual workshops, organized by Adam Aczel and Stuart Calder, ensures continuous engagement with the early career principal investigators (PIs) of the quantum materials neutron scattering community. Through a series of short scientific talks presented by the external PIs, members of the Neutron Scattering Division (NSD) learn about their scientific interests and needs. Presentations from ORNL staff members also help to inform the external PIs about the current state of ORNL’s quantum materials neutron scattering program. Topics covered include the current instrument suites, sample environment, data reduction, visualization, and analysis, and future neutron scattering and complementary capabilities. Feedback is solicited from the external PIs in all these key areas and communicated to NSD management in the form of a workshop report. This workshop series also helps to foster collaborations between NSD scientists and the research groups of the external PIs and plays an important role in attracting new neutron scattering users.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

2022 Quantum Materials Young Investigators Workshop Report

The fifth edition of the workshop “Quantum Materials Young Investigators” was held August 18-19, 2022 at the Oak Ridge National Laboratory (ORNL). This workshop followed up on previous meetings that took place at ORNL starting in 2016. This important series of annual workshops, organized by Adam Aczel and Stuart Calder, ensures continuous engagement with the early career principal investigators (PIs) of the quantum materials neutron scattering community. Through a series of short scientific talks presented by the external PIs, members of the Neutron Scattering Division (NSD) learn about their scientific interests and needs. Presentations from ORNL staff members also help to inform the external PIs about the current state of ORNL’s quantum materials neutron scattering program. Topics covered include neutron scattering instruments, sample environment, neutron polarization, data reduction, visualization, and analysis, and future neutron scattering and complementary capabilities. Feedback is solicited from the external PIs in some or all of these key areas and communicated to NSD management in the form of a workshop report. This workshop series also helps to foster collaborations between NSD scientists and the research groups of the external PIs and plays an important role in attracting new neutron scattering users.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Extracting LANSCE Macrobunch Charge from WNR Fast Pickoff [Slides]

Over several days around December 18, 2023, high-charge minipulses and macropulses were sent to Target 2, also known as the Blue Room. This report presents the calibration of a stripline-type current monitor known as the Fast Pickoff, and subsequent charge data for many of these shots. This effort utilized a fast oscilloscope, a nearby Bergoz current monitor, and some data-reduction techniques.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Radiation-Hard Smart-Pixel Detector ASIC ReadOut with Digital AI in 28nm

Detectors at future high energy colliders will face enormous technical challenges. Disentangling the unprecedented numbers of particles expected in each event will require highly granular silicon pixel detectors with billions of readout channels. With event rates as high as 40 MHz, these detectors will generate petabytes of data per second. To enable discovery within strict bandwidth and latency constraints, future trackers must be capable of fast, power efficient, and radiation hard data-reduction at the source. This effort is pursuing the co-design development of high-performance readout smart pixel ASICs for a future Phase III High Luminosity upgrade of the Large Hadron Collider. A 1.6mm2 ASIC prototype was designed by Fermilab in CMOS 28 nm bulk process and submitted for manufacturing in February 2024. It leverages the analog front-end pixel design of a previous prototype fabricated and tested in 2023, which achieved a simulated detection level of ~400e- with 30fF input capacitance. The ROIC consists of two matrices of 16×16 smart pixels, each 25×25 μm2 in size. Each smart pixel contains a charge-sensitive preamplifier with leakage current compensation and three auto-zero comparators for a 2-bit flash-type ADC. There is digital space for the integration of our fully combinatorial AI that performs momentum classification at the bunch crossing rate. The total power consumption is ∼6μW per pixel, which corresponds to ~1mW/cm2. The ASIC incorporates programmable front-end charge injection circuitry to generate pixel cluster charges during characterization. The cluster profile will be generated to duplicate hit characteristics of various momentum (pT). We will present early results from chip testing.

Parpillon, Benjamin↗
DOE OSTI2024

10 Boron-film-based gas detectors at ESS

The development of detectors for the European Spallation Source is an important parallel element to the effort put into the design and construction of the neutron source and instruments. The 10Boron-film-based detector developments that started over a decade ago as basic detector concepts have now reached technical maturity after intense prototyping work and numerous testing campaigns. Several of the ESS beamlines that will soon enter the commissioning phase started welcoming the detector systems built with the 10 B-film converter technology. The real-size demonstrators evolved in the last 2–3 years into a diverse suite of gas proportional counters for use in diffraction, reflectometry and small-angle scattering studies in spite of the operational complexity posed by the requirements for large-area coverage, low material budget and robustness for operation in the high-flux and high-radiation environment of ESS. The detectors are now being shipped to ESS or undergoing the last performance and calibration tests before being handed over to the instrument teams for installation in the host beamlines. A common feature of these detector systems is the very large number of readout channels that they are instrumented with in order to fulfill the demanding requirements for sensitivity, spatial resolution and count-rate capability. Across all of the detector types that will operate at ESS, the integration, testing and commissioning of the read-out technologies and software tools for data reduction, calibration and analysis are the focus of the detector and integration teams. These will yield a wealth of knowledge about their operation as well as initial results on the in-situ performance, a very important asset to ensure rapid commissioning of the detectors when neutrons from the ESS source become available. In this paper we will give an overview of the 10 B-film-based detector technologies included in the ESS detector suite that are currently facing the transition from the production phase to installation and integration with the other beamline components, which comes with its own specific challenges of both organizational and technical nature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

The Third Data Release of the KODIAQ Survey

We present and make publicly available the third data release (DR3) of the Keck Observatory Database of Ionized Absorption toward Quasars (KODIAQ) survey. KODIAQ DR3 consists of a fully reduced sample of 727 quasars at 0.1 < z {sub em} < 6.4 observed with the Echellette Sepctrograph and Imager at moderate resolution (4000 ≤ R ≤ 10,000). DR3 contains 872 spectra available in flux calibrated form, representing a sum total exposure time of ∼2.8 megaseconds. These coadded spectra arise from a total of 2753 individual exposures of quasars taken from the Keck Observatory Archive (KOA) in raw form and uniformly processed using a data reduction package made available through the XIDL distribution. DR3 is publicly available to the community, housed as a higher level science product at the KOA and in the igmspec database.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

DRAGraces: A Pipeline for the GRACES High-resolution Spectrograph at Gemini

This paper describes the software Data Reduction and Analysis for GRACES (DRAGraces), which is a pipeline reducing spectra from Gemini Remote Access to the CFHT ESPaDOnS Spectrograph (GRACES) at the Gemini North Telescope. The code is written in the IDL language. It is designed to find all the GRACES frames in a given directory, automatically determine the list of bias, flat, arc, and science frames, and perform the whole reduction and extraction within a few minutes. We compare the output from DRAGraces with that of the Open source Pipeline for ESPaDOnS Reduction and Analysis (OPERA), a pipeline developed at the Canada–France–Hawaii Telescope (CFHT) that also can extract GRACES spectra. Both pipelines were developed completely independently, yet they give very similar extracted spectra. They both have their advantages and disadvantages. For instance, DRAGraces is more straightforward and easy to use and is less likely to be derailed by a parameter that needs to be tweaked, while OPERA offers a more careful extraction that can be significantly superior when the highest resolution is required and when the signal-to-noise ratio is low. One should compare both before deciding which one to use for their science. Yet, both pipelines deliver a fairly comparable resolution power (R ~ 52.8k and 36.6k for DRAGraces and R ~ 58k and 40k for OPERA in high- and low-resolution spectral modes, respectively), wavelength solution, and signal-to-noise ratio per resolution element.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Ground Vibrational State SiO Emission in the VLA BAaDE Survey

Using a subsample of the Bulge Asymmetries and Dynamical Evolution (BAaDE) survey of stellar SiO masers, we explore the prevalence and characteristics of {sup 28}SiO J = 1 − 0, v = 0 emission. We identify 90 detections of maser, thermal, or composite {sup 28}SiO J = 1 − 0, v = 0 emission out of approximately 13,000 candidate spectra from the National Science Foundation’s Karl G. Jansky Very Large Array (VLA). We find that the detected sources are likely asymptotic giant branch stars belonging to a bright, foreground Milky Way stellar disk population. For the 32 sources showing thermal components, we extract values for outflow velocity by fitting thermal line profiles. We find a range of circumstellar envelope expansion velocities, and compare to previously recorded OH and CO expansion velocities. This preliminary survey is already the largest study of stellar ground vibrational state SiO masers to date, and will be expanded to include the entire VLA BAaDE data set when data reduction for the 18,988 target sources is completed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Measuring Young Stars in Space and Time. I. The Photometric Catalog and Extinction Properties of N44

In order to better understand the role of high-mass stellar feedback in regulating star formation in giant molecular clouds, we carried out a Hubble Space Telescope (HST) Treasury Program Measuring Young Stars in Space and Time (MYSST) targeting the star-forming complex N44 in the Large Magellanic Cloud (LMC). Using the F555W and F814W broadband filters of both the ACS and WFC3/UVIS, we built a photometric catalog of 461,684 stars down to m {sub F555W} ≃ 29 mag and m {sub F814W} ≃ 28 mag, corresponding to the magnitude of an unreddened 1 Myr pre-main-sequence star of ≈ 0.09 M {sub ☉} at the LMC distance. In this first paper we describe the observing strategy of MYSST and the data reduction procedure and present the photometric catalog. We identify multiple young stellar populations tracing the gaseous rim of N44's superbubble, together with various contaminants belonging to the LMC field population. We also determine the reddening properties from the slope of the elongated red clump (RC) feature by applying the machine-learning algorithm RANSAC, and we select a set of upper-main-sequence stars as primary probes to build an extinction map, deriving a relatively modest median extinction A {sub F555W} ≃ 0.77 mag. The same procedure applied to the RC provides A {sub F555W} ≃ 0.68 mag.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Disequilibrium Chemistry in Exoplanet Atmospheres Observed with the Hubble Space Telescope

Literature on the theory of exoplanet atmospheric disequilibrium chemistry is rich, although its observational counterpart has yet to emerge beyond the hints provided by a few targets in dedicated studies. We report results from an uniform data reduction and analysis for a catalog of 62 Hubble Space Telescope exoplanet transit spectra where we assess the atmospheric model preference for disequilibrium chemistry (i.e., water vapor is not the dominant absorption spectral signature) over thermal equilibrium chemistry in a comparative planetology context. Where model preference assessment is possible, we find that disequilibrium occurs in about half of the atmospheres, indicating that disequilibrium processes play an important role in the composition of exoplanet atmospheres. While very hot atmospheres, over 1800 K, prefer equilibrium chemistry, we find a clustering of preference for disequilibrium in the 1200–1800 K temperature range. We suggest that UV-augmented thermochemistry may play a significant role for those atmospheres.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗