Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,567 records · Page 87

Quantum-inspired computational imaging

Computational imaging combines measurement and computational methods with the aim of forming images even when the measurement conditions are weak, few in number, or highly indirect. The recent surge in quantum-inspired imaging sensors, together with a new wave of algorithms allowing on-chip, scalable and robust data processing, has induced an increase of activity with notable results in the domain of low-light flux imaging and sensing. We provide an overview of the major challenges encountered in low-illumination (e.g., ultrafast) imaging and how these problems have recently been addressed for imaging applications in extreme conditions. Finally, these methods provide examples of the future imaging solutions to be developed, for which the best results are expected to arise from an efficient codesign of the sensors and data analysis tools.

97 MATHEMATICS AND COMPUTING↗

Real-Time Machine Learning Inferencing with Edge Computing Devices from Google and Intel

Machine Learning (ML) has been demonstrated to accelerate discovery and improve the accuracy of many measurements in astrophysics and high energy physics research. As an increasingly commonplace tool, we have reached a new set of challenges in the deployment of ML, at the forefront of which is their computational complexity. The goal of this project is to explore the viability of dedicated machine learning hardware, such as Google’s Coral/Edge TPU and Intel’s Movidius Myriad devices, in astrophysics and high energy physics applications. ML algorithms, while faster than traditional methods, can become the bottleneck in data processing pipelines --- which is a critical issue in systems that require low latency. Within the context of high energy physics and astrophysics, we test this hardware in an attempt to find if it is able to reduce the computational cost of machine learning. We have benchmarked some of these devices, specifically the Google Coral Dev Board and th e Google AIY Vision Kit (Containing Intel’s Movidius Myriad 2).This was done via a strong gravitational lens finding application and a known data set of lenses, simulating a realistic astrophysics application of machine learning, and compare their results to that of traditional computer hardware.

Hawks, Benjamin↗

V-FASTR: THE VLBA FAST RADIO TRANSIENTS EXPERIMENT

Recent discoveries of dispersed, non-periodic impulsive radio signals with single-dish radio telescopes have sparked significant interest in exploring the relatively uncharted space of fast transient radio signals. Here we describe V-FASTR, an experiment to perform a blind search for fast transient radio signals using the Very Long Baseline Array (VLBA). The experiment runs entirely in a commensal mode, alongside normal VLBA observations and operations. It is made possible by the features and flexibility of the DiFX software correlator that is used to process VLBA data. Using the VLBA for this type of experiment offers significant advantages over single-dish experiments, including a larger field of view, the ability to easily distinguish local radio-frequency interference from real signals, and the possibility to localize detected events on the sky to milliarcsecond accuracy. We describe our software pipeline, which accepts short integration ({approx} ms) spectrometer data from each antenna in real time during correlation and performs an incoherent dedispersion separately for each antenna, over a range of trial dispersion measures. The dedispersed data are processed by a sophisticated detector and candidate events are recorded. At the end of the correlation, small snippets of the raw data at the time of the events are stored for further analysis. We present the results of our event detection pipeline from some test observations of the pulsars B0329+54 and B0531+21 (the Crab pulsar).

79 ASTRONOMY AND ASTROPHYSICS↗

Sighten Final Technical Report DEEE0006690 Deploying an integrated and comprehensive solar financing software platform

Over the project, Sighten built a comprehensive software-as-a-service (Saas) platform to automate and streamline the residential solar financing workflow. Before the project period, significant time and money was spent by companies on front-end tools related to system design and proposal creation, but comparatively few resources were available to support the many back-end calculations and data management processes that underpin third party financing. Without a tool like Sighten, the solar financing processes involved passing information from the homeowner prospect into separate tools for system design, financing, and then later to reporting tools including Microsoft Excel, CRM software, in-house software, outside software, and offline, manual processes. Passing data between tools and attempting to connect disparate systems results in inefficiency and inaccuracy for the industry. Sighten was built to consolidate all financial and solar-related calculations in a single software platform. It significantly improves upon the accuracy of these calculations and exposes sophisticated new analysis tools resulting in a rigorous, efficient and cost-effective toolset for scaling residential solar. Widely deploying a platform like Sighten’s significantly and immediately impacts the residential solar space in several important ways: 1) standardizing and improving the quality of all quantitative calculations involved in the residential financing process, most notably project finance, system production and reporting calculations; 2) representing a true step change in terms of reporting and analysis capabilities by maintaining more accurate data and exposing sophisticated tools around simulation, tranching, and financial reporting, among others, to all stakeholders in the space; 3) allowing a broader group of developers/installers/finance companies to access the capital markets by providing an out-of-the-box toolset that handles the execution of running investor capital through a rooftop solar financing program. Standardizing and improving all calculations, improving data quality, and exposing new analysis tools previously unavailable affects investment in the residential space in several important ways: 1) lowering the cost of capital for existing capital providers by mitigating uncertainty and de-risking the solar asset class; 2) attracting new, lower cost investors to the solar asset class as reporting and data quality resemble standards of more mature asset classes; 3) increasing the prevalence of liquidity options for investors through back leverage, securitization, or secondary sale by providing the tools necessary for lenders, ratings agencies, etc. to properly understand a portfolio of residential solar assets. During the project period, Sighten successfully built and scaled a commercially ready tool for the residential solar market. The software solution built by Sighten has been deployed with key target customer segments identified in the award deliverables: solar installers, solar developers/channel managers, and solar financiers, including lenders. Each of these segments greatly benefits from the availability of the Sighten toolset.

14 SOLAR ENERGY↗

Element partitioning in combustion- and gasification-based waste-to-energy units

Highlights: ► Element partitioning of waste-to-energy units by means of a substance flow analysis. ► A comparison between moving grate combustors and high temperature gasifiers. ► Classification of key elements according to their behavior during WtE processes. ► Slags and metals from waste gasifiers are completely and immediately recyclable. ► Potential reduction of amounts of solid residue to be sent to landfill disposal. - Abstract: A critical comparison between combustion- and gasification-based waste-to-energy systems needs a deep knowledge of the mass flows of materials and elements inside and throughout the units. The study collected and processed data from several moving grate conventional incinerators and high-temperature shaft gasifiers with direct melting, which are in operation worldwide. A material and substance flow analysis was then developed to systematically assess the flows and stocks of materials and elements within each waste-to-energy unit, by connecting the sources, pathways, and intermediate and final sinks of each species. The patterns of key elements, such as carbon, chloride and heavy metals, in the different solid and gaseous output streams of the two compared processes have been then defined. The combination of partitioning coefficients with the mass balances on atomic species and results of mineralogical characterization from recent literatures was used to estimate a composition of bottom ashes and slags from the two types of waste-to-energy technologies. The results also allow to quantify some of the performance parameters of the units and, in particular, the potential reduction of the amount of solid residues to be sent to final disposal.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A New Black Carbon Sensor for Dense Air Quality Monitoring Networks

Low-cost air pollution sensors are emerging and increasingly being deployed in densely distributed wireless networks that provide more spatial resolution than is typical in traditional monitoring of ambient air quality. However, a low-cost option to measure black carbon (BC)—a major component of particulate matter pollution associated with adverse human health risks—is missing. This paper presents a new BC sensor designed to fill this gap, the Aerosol Black Carbon Detector (ABCD), which incorporates a compact weatherproof enclosure, solar-powered rechargeable battery, and cellular communication to enable long-term, remote operation. This paper also demonstrates a data processing methodology that reduces the ABCD’s sensitivity to ambient temperature fluctuations, and therefore improves measurement performance in unconditioned operating environments (e.g., outdoors). A fleet of over 100 ABCDs was operated outdoors in collocation with a commercial BC instrument (Magee Scientific, Model AE33) housed inside a regulatory air quality monitoring station. The measurement performance of the 105 ABCDs is comparable to the AE33. The fleet-average precision and accuracy, expressed in terms of mean absolute percentage error, are 9.2 ± 0.8% (relative to the fleet average data) and 24.6 ± 0.9% (relative to the AE33 data), respectively (fleet-average ± 90% confidence interval).

47 OTHER INSTRUMENTATION↗

Integrated Process Monitoring based on Systems of Sensors for Enhanced Nuclear Safeguards Sensitivity and Robustness

This paper illustrates safeguards benefits that process monitoring (PM) can have as a diversion deterrent and as a complementary safeguards measure to nuclear material accountancy (NMA). In order to infer the possible existence of proliferation-driven activities, the objective of NMA-based methods is often to statistically evaluate materials unaccounted for (MUF) computed by solving a given mass balance equation related to a material balance area (MBA) at every material balance period (MBP), a particular objective for a PM-based approach may be to statistically infer and evaluate anomalies unaccounted for (AUF) that may have occurred within a MBP. Although possibly being indicative of proliferation-driven activities, the detection and tracking of anomaly patterns is not trivial because some executed events may be unobservable or unreliably observed as others. The proposed similarity between NMA- and PM-based approaches is important as performance metrics utilized for evaluating NMA-based methods, such as detection probability (DP) and false alarm probability (FAP), can also be applied for assessing PM-based safeguards solutions. To this end, AUF count estimates can be translated into significant quantity (SQ) equivalents that may have been diverted within a given MBP. A diversion alarm is reported if this mass estimate is greater than or equal to the selected value for alarm level (AL), appropriately chosen to optimize DP and FAP based on the particular characteristics of the monitored MBA, the sensors utilized, and the data processing method employed for integrating and analyzing collected measurements. To illustrate the application of the proposed PM approach, a protracted diversion of Pu in a waste stream was selected based on incomplete fuel dissolution in a dissolver unit operation, as this diversion scenario is considered to be problematic for detection using NMA-based methods alone. Results demonstrate benefits of conducting PM under a system-centric strategy that utilizes data collected from a system of sensors and that effectively exploits known characterizations of sensors and facility operations in order to significantly improve anomaly detection, reduce false alarm, and enhance assessment robustness under unreliable partial sensor information.

97 MATHEMATICS AND COMPUTING↗

Fast jet tagging with MLP-Mixers on FPGAs

We explore the innovative use of MLP-Mixer models for real-time jet tagging and establish their feasibility on resource-constrained hardware like FPGAs. MLP-Mixers excel in processing sequences of jet constituents, achieving state-of-the-art performance on datasets mimicking Large Hadron Collider conditions. By using advanced optimization techniques such as High-Granularity Quantization and Distributed Arithmetic, we achieve unprecedented efficiency. These models match or surpass the accuracy of previous architectures, reduce hardware resource usage by up to 97%, double the throughput, and half the latency. Additionally, non-permutation-invariant architectures enable smart feature prioritization and efficient FPGA deployment, setting a new benchmark for machine learning in real-time data processing at particle colliders.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Generating Uncertainty Distributions for Seismic Signal Onset Times

Signal arrival-time estimation plays a critical role in a variety of downstream seismic analyses, including location estimation and source characterization. Any arrival-time errors propagate through subsequent data-processing results. In this article, we detail a general framework for refining estimated seismic signal arrival times along with full estimation of their associated uncertainty. Using the standard short-term average/long-term average threshold algorithm to identify a search window, we demonstrate how to refine the pick estimate through two different approaches. In both cases, new waveform realizations are generated through bootstrap algorithms to produce full a posteriori estimates of uncertainty of onset arrival time of the seismic signal. The onset arrival uncertainty estimates provide additional data-derived information from the signal and have the potential to influence seismic analysis along several fronts.

58 GEOSCIENCES↗

Quantitative Three-Dimensional Imaging of Heterogeneous Materials by Thermal Tomography

Infrared thermal imaging based on active thermal excitations has been widely used for nondestructive evaluation ( NDE) of materials. While the experimental systems have remained essentially the same during the last few decades, development of advanced data-processing methods has significantly improved the capabilities of this technology. However, many limitations still exist. One fundamental limitation is the requirement, either explicitly or implicitly, of the tested material to be homogeneous such that detected thermal contrasts may be used to determine an average material property or attributed to flaws. In this paper, a new thermal tomography ( TT) method is introduced, which for the first time can evaluate heterogeneous materials by directly imaging their thermal-property variations with space. It utilizes one-sided flash thermal-imaging data to construct the three-dimensional ( 3D) distribution of thermal effusivity in the entire volume of a test sample. Theoretical analyses for single and multilayer material systems were conducted to validate its formulation and to demonstrate its performance. Experimental results for a ceramic composite plate and a thermal barrier coating ( TBC) sample are also presented. It was shown that thermal diffusion is the primary factor that degrades the spatial resolution with depth for TT; the spatial resolutions in the lateral and axial directions were quantitatively evaluated.

47 OTHER INSTRUMENTATION↗

Persistence Control of Engineered Functions in Complex Soil Microbiomes (PerCon SFA), Secure Biosystems Design Project Data Catalog at PNNL DataHub

The Persistence Control of Engineered Functions in Complex Soil Microbiomes Project (PerCon SFA) at Pacific Northwest National Laboratory (PNNL) is a Genomic Sciences Program Biosystems Design, Science Focus Area research project consortium. Collaborating across highly integrated institutions, PerCon SFA scientists are exploring how environmental niches can be sculpted using the mechanisms of genome reduction and metabolic addiction to drive secure rhizosphere community design for robust biomass cropping in challenging environments. The PerCon SFA DataHub project repository contains publication-relevant digital dataset and metadata DOI packages, enabling exploration and download of integrated experimental dataset catalogs publicly available to a global scientific community. and metadata repository allow for exploring and downloading integrated experimental biodesign omics dataset catalogs, including experimental protocols and/or workflows, raw and/or processed data, as required by the repository, and other relevant supporting materials and/or metadata required for research reproducibility and reporting.

59 BASIC BIOLOGICAL SCIENCES↗

Third data release of the Hyper Suprime-Cam Subaru Strategic Program

This work presents the third data release of the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP), a wide-field multi-band imaging survey with the Subaru 8.2 m telescope. HSC-SSP has three survey layers (Wide, Deep, and UltraDeep) with different area coverages and depths, designed to address a wide array of astrophysical questions. This third release from HSC-SSP includes data from 278 nights of observing time and covers about 670 deg 2 in all five broad-band filters (grizy) at the full depth (~26 mag at 5σ depending on filter) in the Wide layer. If we include partially observed areas, the release covers 1470 deg 2 . The Deep and UltraDeep layers have ~80% of the originally planned integration times, and are considered done, as we have slightly changed the observing strategy in order to compensate for various time losses. There are a number of updates in the image processing pipeline. Of particular importance is the change in the sky subtraction algorithm; we subtract the sky on small scales before the detection and measurement stages, which has significantly reduced the number of false detections. Thanks to this and other updates, the overall quality of the processed data has improved since the previous release. However, there are limitations in the data (for example, the pipeline is not optimized for crowded fields), and we encourage the user to check the quality assurance plots as well as a list of known issues before exploiting the data. The data release website is https://hsc-release.mtk.nao.ac.jp.

79 ASTRONOMY AND ASTROPHYSICS↗

High-throughput Li plating quantification for fast-charging battery design

Fast charging of most commercial lithium-ion batteries is limited due to fear of lithium plating on the graphite anode, which is difficult to detect and poses considerable safety risk. In this report we demonstrate the power of simple, accessible and high-throughput cycling techniques to quantify irreversible Li plating spanning data from over 200 cells. We first observe the effects of energy density, charge rate, temperature and state of charge on lithium plating, use the results to refine a mature physics-based electrochemical model and provide an interpretable empirical equation for predicting the plating onset state of charge. We then explore the reversibility of lithium plating and its connection to electrolyte design for preventing irreversible Li accumulation. Finally, we design a method to quantify in situ Li plating for commercially relevant graphite|LiNi 0.5 Mn 0.3 Co 0.2 O 2 (NMC) cells and compare with results from the experimentally convenient Li|graphite configuration. The hypotheses and abundant data herein were generated primarily with equipment universal to the battery researcher, encouraging further development of innovative testing methods and data processing that enable rapid battery engineering.

25 ENERGY STORAGE↗

Guest Editorial for Nondestructive Testing and Evaluation (NDT&E) Special Section

Nondestructive testing and evaluation (NDT&E) are interdisciplinary fields that require a significant amount of interconnection between fundamental physics, measurement techniques, data processing, decision making, and reporting to have a significant impact on industry. NDT&E practitioners are challenged to keep up with the fast-paced evolution of materials, structures, processing, and manufacturing technologies. The development of engineered materials, complex structures and composites, and novel forming techniques require NDT&E to rapidly evolve to meet the needs of industry.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Science of the Van Allen Probes Science Operations Centers

The Van Allen Probes mission operations materialized through a distributed model in which operational responsibility was divided between the Mission Operations Center (MOC) and separate instrument specific SOCs. The sole MOC handled all aspects of telemetering and receiving tasks as well as certain scientifically relevant ancillary tasks. Each instrument science team developed individual instrument specific SOCs proficient in unique capabilities in support of science data acquisition, data processing, instrument performance, and tools for the instrument team scientists. In parallel activities, project scientists took on the task of providing a significant modeling tool base usable by the instrument science teams and the larger scientific community. With a mission as complex as Van Allen Probes, scientific inquiry occurred due to constant and significant collaboration between the SOCs and in concert with the project science team. Planned cross-instrument coordinated observations resulted in critical discoveries during the seven-year mission. Instrument cross-calibration activities elucidated a more seamless set of data products. Specific topics include post-launch changes and enhancements to the SOCs, discussion of coordination activities between the SOCs, SOC specific analysis software, modeling software provided by the Van Allen Probes project, and a section on lessons learned. One of the most significant lessons learned was the importance of the original decision to implement individual team SOCs providing timely and well-documented instrument data for the NASA Van Allen Probes Mission scientists and the larger magnetospheric and radiation belt scientific community.

47 OTHER INSTRUMENTATION↗

Reaching new peaks for the future of the CMS HTCondor Global Pool

The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic resources. This CMS Global Pool, which currently involves over 70 computing sites worldwide and peaks at 350k CPU cores, is employed to successfully manage the simultaneous execution of up to 150k tasks. While the present infrastructure is sufficient to harness the current computing power scales, CMS latest estimates predict a noticeable expansion in the amount of CPU that will be required in order to cope with the massive data increase of the High-Luminosity LHC (HL-LHC) era, planned to start in 2027. This contribution presents the latest results of the CMS Submission Infrastructure team in exploring and expanding the scalability reach of our Global Pool, in order to preventively detect and overcome any barriers in relation to the HL-LHC goals, while maintaining high effciency in our workload scheduling and resource utilization.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Observation of Cosmic-Ray Anisotropy in the Southern Hemisphere with 12 yr of Data Collected by the IceCube Neutrino Observatory

We analyzed the 7.92 × 10 11 cosmic-ray-induced muon events collected by the IceCube Neutrino Observatory from 2011 May 13, when the fully constructed experiment started to take data, to 2023 May 12. This data set provides an up-to-date cosmic-ray arrival direction distribution in the Southern Hemisphere with unprecedented statistical accuracy covering more than a full period length of a solar cycle. Improvements in Monte Carlo event simulation and better handling of year-to-year differences in data processing significantly reduce systematic uncertainties below the level of statistical fluctuations compared to the previously published results. We confirm the observation of a change in the angular structure of the cosmic-ray anisotropy between 10 TeV and 1 PeV, more specifically in the 100–300 TeV energy range. For the first time, we analyzed the angular power spectrum at different energies. The observed variations of the power spectra with energy suggest relatively reduced large-scale features at high energy compared to those of medium and small scales. The large volume of data enhances the statistical significance at higher energies, up to the PeV scale, and smaller angular scales, down to approximately 6° compared to previous findings.

79 ASTRONOMY AND ASTROPHYSICS↗

Data and scripts from: “Denoising autoencoder for reconstructing sensor observation data and predicting evapotranspiration: noisy and missing values repair and uncertainty quantification”

This data package includes data and scripts from the manuscript “Denoising autoencoder for reconstructing sensor observation data and predicting evapotranspiration: noisy and missing values repair and uncertainty quantification”.The study addressed common challenges faced in environmental sensing and modeling, including uncertain input data, missing sensor observations, and high-dimensional datasets with interrelated but redundant variables. Point-scaled meteorological and soil sensor observations were perturbed with noises and missing values, and denoising autoencoder (DAE) neural networks were developed to reconstruct the perturbed data and further predict evapotranspiration. This study concluded that (1) the reconstruction quality of each variable depends on its cross-correlation and alignment to the underlying data structure, (2) uncertainties from the models were overall stronger than those from the data corruption, and (3) there was a tradeoff between reducing bias and reducing variance when evaluating the uncertainty of the machine learning models.This package includes:(1) Four ipython scripts (.ipynb): “DAE_train.ipynb” trains and evaluates DAE neural networks, “DAE_predict.ipynb” makes predictions from the trained DAE models, “ET_train.ipynb” trains and evaluates ET prediction neural networks, and “ET_predict.ipynb” makes predictions from trained ET models.(2) One python file (.py): “methods.py” includes all user-defined functions and python codes used in the ipython scripts.(3) A “sub_models” folder that includes five trained DAE neural networks (in pytorch format, .pt), which could be used to ingest input data before being fed to the downstream ET models in ‘ET_train.ipynb” or ‘ET_predict.ipynb’.(4) Two data files (.csv). Daily meteorological, vegetation, and soil data is in “df_data.csv”, where “df_meta.csv” contains the location and time information of “df_data.csv”. Each row (index) in “df_meta.csv” corresponds to each row in “df_data.csv”. These data files are formatted to follow the data structure requirements and be directly used in the ipython scripts, and they have been shuffled chronologically to train machine learning models. The meteorological and soil data was collected using point sensors between 2019-2023 at(4.a) Three shrub-dominated field sites in East River, Colorado (named “ph1”, “ph2” and “sg5” in “df_meta.csv”, where “ph1” and “ph2” were located at PumpHouse Hillslopes, and “sg5” was at Snodgrass Mountain meadow) and(4.b) One outdoor, mesoscale, and herbaceous-dominated experiment in Berkeley, California (named “tb” in “df_meta.csv”, short for Smartsoils Testbed at Lawrence Berkeley National Lab).- See "df_data_dd.csv" and "df_meta_dd.csv" for variable descriptions and the Methods section for additional data processing steps. See "flmd.csv" and "README.txt" for brief file descriptions.- All ipython scripts and python files are written in and require PYTHON language software.

54 ENVIRONMENTAL SCIENCES↗