SEARCH · Engineering Papers

Results for “Data processing and standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Melt pool temperature measurement and monitoring during laser powder bed fusion based additive manufacturing via single-camera two-wavelength imaging pyrometry (STWIP)

Melt pool (MP) temperature is one of the determining factors and a key signature for evaluating the properties of printed components in metal additive manufacturing (AM). The state-of-the-art measurement systems are hindered, primarily by the large-scale data acquisition and processing demands. In this work, we introduce a novel coaxial, high-speed, single-camera two-wavelength imaging pyrometer (STWIP) system as opposed to the typical utilization of multiple cameras for measuring MP temperature profiles in laser powder bed fusion (LPBF) processes. Developed on a commercial LPBF machine (EOS M290), the STWIP system demonstrated its ability to quantitatively monitor the MP temperature and its variation for 50 layers at high framerates (>30,000 fps) for a real-world application (standard fatigue specimens) print. High performance computing is employed to analyze the acquired big data (MP images), for determining each MP's average temperature and 2D temperature profile. The MP temperature evolution in the gage section of a fatigue specimen is also examined at a temporal resolution of 1 ms, by evaluating the MP temperatures in the samples' first, middle, and last layers. This report is the first of its kind on monitoring MP temperature distribution and evolution at such a large, detailed scale for longer durations in practical applications.

42 ENGINEERING↗

DOE OSTI2025

Implications of a weakening N = 126 shell closure away from stability for r -process astrophysical conditions

The formation of the third r-process abundance peak near A ∼ 195 is highly sensitive to both nuclear structure far from stability and the astrophysical conditions that produce the heaviest elements. In particular, the N = 126 shell closure plays a crucial role in shaping this peak. Experimental data hints that the shell weakens as proton number departs from Z = 82, a trend largely missed by global mass models. To investigate its impact on r-process nucleosynthesis, we employ both standard global models with strong closures and modified Duflo-Zuker (DZ) models that reproduce the weakening, combined with three sets of β − -decay rates. Strong shell closures generate sharply peaked abundances, whereas weakened closures consistent with the experimental trend produce broader, flatter patterns. Accurately reproducing the solar third peak under weakened shell strength requires sufficiently neutron-rich conditions that significant fission occurs, and slower decay rates. These results demonstrate that a weakening N = 126 shell closure away from stability imposes significant constraints on the astrophysical environments of the r-process and underscores the need for precise mass measurements and improved characterization of β − -decay properties in this region.

N = 126 closed shells↗

DOE OSTI2021

AutoCCS: automated collision cross-section calculation software for ion mobility spectrometry–mass spectrometry

Abstract Motivation Ion mobility spectrometry (IMS) separations are increasingly used in conjunction with mass spectrometry (MS) for separation and characterization of ionized molecular species. Information obtained from IMS measurements includes the ion’s collision cross section (CCS), which reflects its size and structure and constitutes a descriptor for distinguishing similar species in mixtures that cannot be separated using conventional approaches. Incorporating CCS into MS-based workflows can improve the specificity and confidence of molecular identification. At present, there is no automated, open-source pipeline for determining CCS of analyte ions in both targeted and untargeted fashion, and intensive user-assisted processing with vendor software and manual evaluation is often required. Results We present AutoCCS, an open-source software to rapidly determine CCS values from IMS-MS measurements. We conducted various IMS experiments in different formats to demonstrate the flexibility of AutoCCS for automated CCS calculation: (i) stepped-field methods for drift tube-based IMS (DTIMS), (ii) single-field methods for DTIMS (supporting two calibration methods: a standard and a new enhanced method) and (iii) linear calibration for Bruker timsTOF and non-linear calibration methods for traveling wave based-IMS in Waters Synapt and Structures for Lossless Ion Manipulations. We demonstrated that AutoCCS offers an accurate and reproducible determination of CCS for both standard and unknown analyte ions in various IMS-MS platforms, IMS-field methods, ionization modes and collision gases, without requiring manual processing. Availability and implementation https://github.com/PNNL-Comp-Mass-Spec/AutoCCS. Supplementary information Supplementary data are available at Bioinformatics online. Demo datasets are publicly available at MassIVE (Dataset ID: MSV000085979).

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Efficient Data Management in Neutron Scattering Data Reduction Workflows at ORNL

Oak Ridge National Laboratory (ORNL) experimental neutron science facilities produce 1.2 TB a day of raw event-based data that is stored using the standard metadata-rich NeXus schema built on top of the HDF5 file format. Performance of several data reduction workflows is largely determined by the amount of time spent on the loading and processing algorithms in Mantid, an open-source data analysis framework used across several neutron sciences facilities around the world. The present work introduces new data management algorithms to address identified input output (I/O) bottlenecks on Mantid. First, we introduce an in-memory binary-tree metadata index that resemble NeXus data access patterns to provide a scalable search and extraction mechanism. Second, data encapsulation in Mantid algorithms is optimally redesigned to reduce the total compute and memory runtime footprint associated with metadata I/O reconstruction tasks. Results from this work show speed ups in wall-clock time on ORNL data reduction workflows, ranging from 11% to 30% depending on the complexity of the targeted instrument-specific data. Nevertheless, we highlight the need for more research to address reduction challenges as experimental data volumes increase.

Godoy, William↗

DOE OSTI2021

Improving Prediction of Peroxide Value of Edible Oils Using Regularized Regression Models

We present four unique prediction techniques, combined with multiple data pre-processing methods, utilizing a wide range of both oil types and oil peroxide values (PV) as well as incorporating natural aging for peroxide creation. Samples were PV assayed using a standard starch titration method, AOCS Method Cd 8-53, and used as a verified reference method for PV determination. Near-infrared (NIR) spectra were collected from each sample in two unique optical pathlengths (OPLs), 2 and 24 mm, then fused into a third distinct set. All three sets were used in partial least squares (PLS) regression, ridge regression, LASSO regression, and elastic net regression model calculation. While no individual regression model was established as the best, global models for each regression type and pre-processing method show good agreement between all regression types when performed in their optimal scenarios. Furthermore, small spectral window size boxcar averaging shows prediction accuracy improvements for edible oil PVs. Best-performing models for each regression type are: PLS regression, 25 point boxcar window fused OPL spectral information RMSEP = 2.50; ridge regression, 5 point boxcar window, 24 mm OPL, RMSEP = 2.20; LASSO raw spectral information, 24 mm OPL, RMSEP = 1.80; and elastic net, 10 point boxcar window, 24 mm OPL, RMSEP = 1.91. The results show promising advancements in the development of a full global model for PV determination of edible oils.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Search for Higgs boson production in association with a high-energy photon via vector-boson fusion with decay into bottom quark pairs at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search is presented for the production of the Standard Model Higgs boson in association with a high-energy photon. With a focus on the vector-boson fusion process and the dominant Higgs boson decay into b-quark pairs, the search benefits from a large reduction of multijet background compared to more inclusive searches. Results are reported from the analysis of 132 fb –1 of pp collision data at $\sqrt{s}$ = 13 TeV collected with the ATLAS detector at the LHC. The measured Higgs boson signal yield in this final-state signature is 1.3 ± 1.0 times the Standard Model prediction. The observed significance of the Higgs boson signal above the background is 1.3 standard deviations, compared to an expected significance of 1.0 standard deviations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2026

Full event interpretation with machine-learning-based particle-flow reconstruction in the CMS detector

The particle-flow (PF) algorithm constructs a global description of each particle collision by producing a comprehensive list of final-state particles, and is central to event reconstruction in the CMS experiment at the CERN LHC. The existing PF implementation relies on physics-motivated heuristics and assumptions that can be replaced by machine-learning (ML) models trained directly on simulated data and naturally suited to modern graphics processing units (GPUs). A state-of-the-art ML-based PF (MLPF) reconstruction algorithm, implemented within the CMS software framework, is presented. The MLPF algorithm performs a learnable full-event reconstruction on GPUs, generalizes across detector conditions and collision energies, and replaces multiple modular reconstruction steps with a single unified model. Physics performance comparable to standard PF reconstruction is achieved in both simulation and data, with improved jet energy resolution and inference time. In simulated top quark-antiquark events under LHC Run-3 (2023-2024) conditions, the jet energy resolution improves by 10-20% for jets with transverse momentum between 30-100 GeV. Inference time is evaluated using simulated multijet events, with a median of $20\,\hbox {ms}$ per event on an Nvidia L4 GPU, compared to approximately $110\,\hbox {ms}$ for the standard CMS PF reconstruction.

Hayrapetyan, Aram [Yerevan Phys. Inst.]↗

DOE OSTI2024

Low latency optical-based mode tracking with machine learning deployed on FPGAs on a tokamak

Active feedback control in magnetic confinement fusion devices is desirable to mitigate plasma instabilities and enable robust operation. Optical high-speed cameras provide a powerful, non-invasive diagnostic and can be suitable for these applications. Here, in this study, we process high-speed camera data, at rates exceeding 100 kfps, on in situ field-programmable gate array (FPGA) hardware to track magnetohydrodynamic (MHD) mode evolution and generate control signals in real time. Our system utilizes a convolutional neural network (CNN) model, which predicts the n = 1 MHD mode amplitude and phase using camera images with better accuracy than other tested non-deep-learning-based methods. By implementing this model directly within the standard FPGA readout hardware of the high-speed camera diagnostic, our mode tracking system achieves a total trigger-to-output latency of 17.6 μs and a throughput of up to 120 kfps. This study at the High Beta Tokamak-Extended Pulse (HBT-EP) experiment demonstrates an FPGA-based high-speed camera data acquisition and processing system, enabling application in real-time machine-learning-based tokamak diagnostic and control as well as potential applications in other scientific domains.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

A Simple Data-Centric Methodology for Producible Geothermal Well Determinations: Preprint

The Bureau of Land Management (BLM) has traditionally lacked a standardized methodology for determining if a newly drilled geothermal well is "producible," a designation essential for deciding whether a lease should be "held by production." This is a straightforward problem to solve in oil and gas: Demonstrate that a well is economically viable, meaning it produces sufficient oil or gas to exceed direct operating costs and lease-related expenses, such as rentals or minimum royalties. In geothermal, the problem is more complex: Geothermal wells are tightly coupled with the downstream infrastructure - specifically, the power plant, which is often not designed until well after a lease is deemed as "held by production." Although this designation is critical for advancing geothermal power plant development on BLM-managed lands, current geothermal well assessments often rely on ad hoc approaches that can be complex, operator-biased, and heavy in assumptions related to economic viability. To address this, we have developed two complementary methodologies: a minimum power requirement-based approach and a productivity index (PI)-based approach. These methods leverage key flow test data - pressure, temperature, flow rate, and specific enthalpy - to provide reliable and standardized producible well determinations. The minimum power requirement-based approach evaluates wells against specific power output thresholds informed by reservoir experts and the associated temperature requirements. The PI-based approach assesses well productivity using widely accepted reservoir engineering metrics, proposing a threshold of 2.5 kg/s/bar. Both methods are data-driven and grounded in empirical production data from operational geothermal wells, avoiding uncertain economic assumptions while maintaining decision-making accuracy. Wells falling below key performance thresholds (i.e., PI, specific power) are deemed non-producible. These methodologies aim to streamline BLM's decision-making process, reduce nontechnical barriers to geothermal energy adoption, and enable regulatory expansion into states lacking geothermal expertise. Preliminary results indicate clear trends and thresholds in production data that provide actionable insights for evaluating well producibility. Validation using well completion report (WCR) data is ongoing, with promising results demonstrating the potential for these standardized methodologies to impact geothermal development significantly.

15 GEOTHERMAL ENERGY↗

DOE OSTI2021

Decentralized Low-Rank State Estimation for Power Distribution Systems

This article considers the low-observability state estimation problem in power distribution networks and develops a decentralized state estimation algorithm leveraging the matrix completion methodology. Matrix completion has been shown to be an effective technique in state estimation that exploits the low dimensionality of the power system measurements to recover missing information. This technique can utilize an approximate (linear) load flow model, or it can be used with no physical models in a network where no information about the topology or line admittance is available. The direct application of matrix completion algorithms requires solving a semi-definite programming (SDP) problem, which becomes computationally challenging for large networks. We therefore develop a decentralized algorithm that capitalizes on the popular proximal alternating direction method of multipliers (proximal ADMM). The method allows us to distribute the computation among different areas of the network, leading to a scalable algorithm. By doing all computations at individual control areas and only communicating with neighboring areas, the algorithm eliminates the need for data to be sent to a central processing unit and thus increases efficiency and contributes to the goal of autonomous control of distribution networks. We illustrate the advantages of the proposed algorithm numerically using standard IEEE test cases.

41 EE - Solar Energy Technologies Office (EE-4S)↗

DOE OSTI2025

Host Onboarding Tool (HObT) v1.0.0

The Host OnBoarding Tool (Hobt) is a publicly accessible, web-based software designed to organize and share information about microbial hosts under development at the Agile BioFoundry (ABF). It streamlines the assessment, tracking, and sharing of information related to microbial host development and provides a centralized platform where users can rapidly evaluate hosts' readiness for various bio processes. HObT leverages the Tier System, a standardized host development framework that organizes and assesses microbial hosts based on their readiness for biomanufacturing. Each tier outlines key targets—including genetic tools, growth conditions, omics data, and predictive models—needed to transform new or emerging microbes into established production platforms. By applying clear criteria for advancement, the Tier System helps users quickly evaluate each organism's current development status, identify gaps in available knowledge or tools, and prioritize future strain improvement efforts. Through its user-friendly interface, HObT encourages contributions of new data and insights from researchers, fostering collaboration and accelerating host development. By providing structured guidance for microbial strain advancement, HObT and the Tier System support more systematic, rapid, and cost-effective development of non-traditional microbial hosts, ultimately enhancing the efficiency and impact of biomanufacturing research and applications.

Plahar, Hector [Lawrence Berkeley National Laborat↗

DOE OSTI2022

UAE6 - Wind Tunnel Tests Data - UAE6 - Sequence S - Raw Data

Sequences S, T, and U: Upwind, No Probes (F); Upwind 2° Pitch (F); Upwind 4° Pitch (F) This test sequence used an upwind, rigid turbine with a 0° cone angle. The wind speed ranged from 5 m/s to 25 m/s. Yaw angles of 0° to 180° were achieved for Sequence S, but the yaw angle remained at 0° for Sequences T and U. The blade tip pitch was 3° for Sequence S, 2° for Sequence T, and 4° for Sequence U. These three sequences were interleaved during testing because the pitch angle change was easily made by the turbine operator. The rotor rotated at 72 RPM. Blade pressure measurements were collected. The five-hole probes were removed and the plugs were installed. Plastic tape 0.03-mm-thick was used to smooth the interface between the plugs and the blade. The teeter dampers were replaced with rigid links, and these two channels were flagged as not applicable by setting the measured values in the data file to -99999.99 Nm. The teeter link load cell was pre-tensioned to 40,000 N. During post-processing, the probe channels were set to read -99999.99. In addition to the standard 30-second campaigns, yaw sweeps were done at 7 m/s and 10 m/s for the Sequence S configuration. These 6-minute campaigns were collected while the yaw drive rotated the turbine 360° at a rate of 1°/s. The file names for these campaigns use the letter designation, followed by two digits for wind speed, followed by YSU, followed by 00.

17 WIND ENERGY↗

DOE OSTI2022

UAE6 - Wind Tunnel Tests Data - UAE6 - Sequence T - Raw Data

17 WIND ENERGY↗

DOE OSTI2022

UAE6 - Wind Tunnel Tests Data - UAE6 - Sequence U - Raw Data

17 WIND ENERGY↗

DOE OSTI2026

Improving Chirped Fiber Bragg Grating Resolution for Position-Sensitive Sensors in Shock- and Detonation-Driven Experiments

Chirped fiber Bragg gratings (CFBGs) are robust diagnostic sensors that are widely used to track detonation-driven and shock wave propagation. CFBGs are inscribed with a linearly chirped periodic index of refraction changes that alter the Bragg wavelength along the length of the probe. The light return of each individual Bragg element is captured by a detector at a unique time to map the full reflected spectrum. The CFBG spectrum is measured with a dispersive Fourier transform of the reflected light that temporally stretches the spectrum to increase spatial resolution and make a one-to-one map of the wavelength on a time axis. Here, we propose an improvement of CFBG temporal resolution by incorporating two co-linear laser pulses with orthogonal polarization states and a 5 ns time offset. The two separate signals were split and tracked by two separate detectors. An oscilloscope captured good separation in the signals, and two separate spectrograms were generated and interleaved in the post-processing of the data. This novel technique doubled the CFBG temporal resolution and led to a doubled location resolution. As a proof-of-concept of this technique, the resolution improvement was compared between standard CFBG measurements and the two polarization states method on a position-sensitive CFBG sensor. CFBG resolution doubling will advance sensor capabilities and will have a direct impact on improving capture and analysis in dynamic, high-explosive experiments.

42 ENGINEERING↗

DOE OSTI2020

A data-driven perspective on the colours of metal–organic frameworks

Colour is at the core of chemistry and has been fascinating humans since ancient times. It is also a key descriptor of optoelectronic properties of materials and is often used to assess the success of a synthesis. However, predicting the colour of a material based on its structure is challenging. In this work, we leverage subjective and categorical human assignments of colours to build a model that can predict the colour of compounds on a continuous scale. In the process of developing the model, we also uncover inadequacies in current reporting mechanisms. For example, we show that the majority of colour assignments are subject to perceptive spread that would not comply with common printing standards. To remedy this, we suggest and implement an alternative way of reporting colour—and chemical data in general. All data is captured in an objective, and standardised, form in an electronic lab notebook and subsequently automatically exported to a repository in open formats, from where it can be interactively explored by other researchers. We envision this to be key for a data-driven approach to chemical research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Validation of semi-analytical, semi-empirical covariance matrices for two-point correlation function for early DESI data

ABSTRACT We present an extended validation of semi-analytical, semi-empirical covariance matrices for the two-point correlation function (2PCF) on simulated catalogs representative of luminous red galaxies (LRGs) data collected during the initial 2 months of operations of the Stage-IV ground-based Dark Energy Spectroscopic Instrument (DESI). We run the pipeline on multiple effective Zel’dovich (EZ) mock galaxy catalogs with the corresponding cuts applied and compare the results with the mock sample covariance to assess the accuracy and its fluctuations. We propose an extension of the previously developed formalism for catalogs processed with standard reconstruction algorithms. We consider methods for comparing covariance matrices in detail, highlighting their interpretation and statistical properties caused by sample variance, in particular, non-trivial expectation values of certain metrics even when the external covariance estimate is perfect. With improved mocks and validation techniques, we confirm a good agreement between our predictions and sample covariance. This allows one to generate covariance matrices for comparable data sets without the need to create numerous mock galaxy catalogs with matching clustering, only requiring 2PCF measurements from the data itself. The code used in this paper is publicly available at https://github.com/oliverphilcox/RascalC.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

A Performant, Scalable Processing Pipeline for High‐Quality and FAIR Environmental Sensor Data

High-resolution environmental monitoring is necessary to record, understand, and predict biogeochemical and ecological changes particularly in coastal systems but brings significant challenges in processing and making rapidly available the resulting data. The COMPASS-FME project established a network of coastal observational sites across the Chesapeake Bay and western Lake Erie regions extensively instrumented with soil, vegetation, and weather sensors logging data every 15 min. Our data processing framework, written in R and completely open source, prioritizes rapid model-experiment iteration and makes biogeochemical data rapidly available for quality assurance/quality control, analysis, and model ingestion. This pipeline is distinguished by a standardized and modular approach to data curation, extensive metadata and documentation, and its high performance. These attributes combine to make biogeochemical data rapidly accessible across COMPASS-FME and the broader community. Flexible, powerful, and reproducible approaches to handling high-volume environmental data are crucial for accelerating biogeosciences research.

Pennington, Stephanie C. [Pacific Northwest Nation↗