Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Adaptive anomaly detection for identifying attacks in cyber-physical systems: A systematic literature review

Modern cyberattacks in cyber-physical systems (CPS) rapidly evolve and cannot be deterred effectively with most current methods, which focus on characterizing past threats. Adaptive anomaly detection (AAD) is among the most promising techniques to detect evolving cyberattacks, with an emphasis on fast data processing and model adaptation. AAD has been researched extensively; however, to the best of our knowledge, our work is the first systematic literature review (SLR) on current research in this field. We present a comprehensive SLR, gathering 397 relevant papers and systematically analyzing 65 of them (47 research and 18 survey papers) on AAD in CPS from 2013 to November 2023. We introduce a novel taxonomy considering attack types, CPS application, learning paradigm, data management, and algorithms. Our findings show that most studies addressed either model adaptation or data processing, but rarely both simultaneously. This indicates a research gap in fully adaptive solutions. We also categorize algorithms, datasets, and attack characteristics, and summarize strengths and weaknesses across the literature. Our review provides a structured and accessible reference for researchers and practitioners, offering insights into key trends and highlighting limitations in current approaches. Finally, we outline several future research directions, including the need for integrated real-time processing and adaptive learning, explainability, and uncertainty quantification in AAD for CPS.

Adaptation↗

IDC Re-Engineering Phase 2 System Requirements Document V1.3.

This System Requirements Document (SRD) defines waveform data processing requirements for the International Data Centre (IDC) of the Comprehensive Nuclear Test Ban Treaty Organization (CTBTO). The IDC applies, on a routine basis, automatic processing methods and interactive analysis to raw International Monitoring System (IMS) data in order to produce, archive, and distribute standard IDC products on behalf of all States Parties. The routine processing includes characterization of events with the objective of screening out events considered to be consistent with natural phenomena or non-nuclear, man-made phenomena. This document does not address requirements concerning acquisition, processing and analysis of radionuclide data but includes requirements for the dissemination of radionuclide data and products.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Statistical Techniques For Real-time Anomaly Detection Using Spark Over Multi-source VMware Performance Data

Anomaly detection refers to the identi cation of an irregular or unusual pat- tern which deviates from what is standard, normal, or expected. Such deviated patterns typically correspond to samples of interest and are assigned different labels in different domains, such as outliers, anomalies, exceptions, or malware. Detecting anomalies in fast, voluminous streams of data is a formidable chal- lenge. This paper presents a novel, generic, real-time distributed anomaly detection framework for heterogeneous streaming data where anomalies appear as a group. We have developed a distributed statistical approach to build a model and later use it to detect anomaly. As a case study, we investigate group anomaly de- tection for a VMware-based cloud data center, which maintains a large number of virtual machines (VMs). We have built our framework using Apache Spark to get higher throughput and lower data processing time on streaming data. We have developed a window-based statistical anomaly detection technique to detect anomalies that appear sporadically. We then relaxed this constraint with higher accuracy by implementing a cluster-based technique to detect sporadic and continuous anomalies. We conclude that our cluster-based technique out- performs other statistical techniques with higher accuracy and lower processing time.

Apache Spark↗

Development of a rate-based ENRTL-RK process model for a water-lean solvent

Advanced water-lean solvents (WLS) for post-combustion CO2 capture offer several advantages over the aqueous amine solvents . WLS have lower parasitic energy penalty, lower corrosion, lower temperature and high-pressure CO2 regeneration leading to lower cost of CO2 capture. RTI International, with funding from the US Department of Energy, has been developing its novel water-lean solvent, that has shown specific reboiler duty of 2.3 GJ/t-CO2 at the 60-kWe pilot testing unit (Tiller Plant, SINTEF, Norway) and 2.6 GJ/t-CO2 at the engineering scale testing system (12 MWe) at the Technology Centre Mongstad (TCM) in Norway. All heat duties, including the one from TCM testing, were consistent with Aspen Plus modeling of the specific configuration of each test plant. This work focuses on the development of a detailed process model using in-house laboratory measurements and process data at pilot scale. The eNTRL-RK model used in this work is based on an unsymmetric activity coefficient model with the reference states chosen to be pure liquids for solvents and ideal dilute solution at unit solute molality (resulting in activity coefficient of unity at infinite dilution) for electrolytes. It uses the Redlich-Kwong equation of state for vapor phase properties and Henry’s law for solubility of supercritical gases. The model was validated using process data from the pilot-scale campaign at the Tiller plant, and the engineering scale test campaign at TCM. Data on CO2 capture rate, absorber, and regenerator temperature profiles and specific reboiler duties from two different test campaigns at Tiller and TCM, were used to further refine and validate the model and the model compares favorably to experimental data. The validation results against TCM campaign will be presented in this work.

CO2 capture↗

Characterization and prediction of the electromechanical wear of contact tips during wire arc additive manufacturing of 316L stainless steel

Here, this study seeks to better understand the degradation of the contact tip with respect to WAAM for a 316L wire electrode as well as explore methods of monitoring the contact tip state from process data. The contact tip, a consumable component, positions the wire and serves as the electrical contact surface between the wire electrode and the welding power supply. The wear of the contact tip was characterized in terms of material loss and material contamination for a set of tips worn to discrete levels as measured by the amount of wire fed or arc time. Geometrical characterization found a 49% increase in the bore exit area at 180 meters of wire fed. Machine learning models were developed to predict the relative bore exit area of the contact tip from arc-based process data and a random forest classifier exhibited favorable performance with a cross-validated f1-score of 0.84. The regression architecture implemented a multi-layer perceptron with the ability to predict the relative exit area with an $R^2$ score of 0.75. Key features used in the prediction include the standard deviation of the voltage and the time between shorts.

Contact tip wear↗

Characterizing Canopy Openness in Open Forests: Spherical Densiometer and Canopy Photography Are Equivalent but Less Sensitive than Direct Measurements of Solar Radiation

In forest ecosystems, canopy openness affects understory light availability, plant growth, and tree species recruitment, thus shaping future forest composition, structure, and functional diversity. Foresters must correctly and quickly measure canopy openness to meet their management objectives. To help guide the selection of an appropriate method for measuring canopy openness, we compared three common techniques that vary in cost, complexity, and time required for measurements and data processing: smartphone-based hemispherical photography, spherical densiometer measurements, and direct measurements of solar radiation (using AccuPAR ceptometer). We measured canopy openness using these three methods on 28 permanent forest health monitoring plots in pine-oak forests of the Central Pine Barrens of Long Island in New York State. By analysis of variance and regression analyses, we found the three methods (particularly densiometer and hemispherical photographs) yielded broadly equivalent and strongly positively correlated descriptions of canopy openness. The direct measurements of solar radiation seemed to have a greater potential to detect subtle variation in forest understory light. Forest managers may sufficiently characterize canopy openness using quick and cheap methods (e.g., spherical densiometers) and avoid larger costs of devices for direct light measurements (e.g., ceptometers) and the larger data processing times of hemispherical photography.

54 ENVIRONMENTAL SCIENCES↗

Advances in targeted proteomics and applications to biomedical research

Targeted proteomics technique has emerged as a powerful protein quantification tool in systems biology, biomedical research, and increasing for clinical applications. The most widely used targeted proteomics approach, selected reaction monitoring (SRM), also known as multiple reaction monitoring (MRM), can be used for quantification of cellular signaling networks and preclinical verification of candidate protein biomarkers. As an extension to our previous review on advances in SRM sensitivity (Shi et al., Proteomics , 12, 1074–1092, 2012) herein we review recent advances in the method and technology for further enhancing SRM sensitivity (from 2012 to present), and highlighting its broad biomedical applications in human bodily fluids, tissue and cell lines. Furthermore, we also review two recently introduced targeted proteomics approaches, parallel reaction monitoring (PRM) and data‐independent acquisition (DIA) with targeted data extraction on fast scanning high‐resolution accurate‐mass (HR/AM) instruments. Such HR/AM targeted quantification with monitoring all target product ions addresses SRM limitations effectively in specificity and multiplexing; whereas when compared to SRM, PRM and DIA are still in the infancy with a limited number of applications. Thus, for HR/AM targeted quantification we focus our discussion on method development, data processing and analysis, and its advantages and limitations in targeted proteomics. Finally, general perspectives on the potential of achieving both high sensitivity and high sample throughput for large‐scale quantification of hundreds of target proteins are discussed.

Shi, Tujin↗

Integration of TomoPy and the ASTRA toolbox for advanced processing and reconstruction of tomographic synchrotron data

The processing of tomographic synchrotron data requires advanced and efficient software to be able to produce accurate results in reasonable time. In this paper, the integration of two software toolboxes, TomoPy and the ASTRA toolbox, which, together, provide a powerful framework for processing tomographic data, is presented. The integration combines the advantages of both toolboxes, such as the user-friendliness and CPU-efficient methods of TomoPy and the flexibility and optimized GPU-based reconstruction methods of the ASTRA toolbox. It is shown that both toolboxes can be easily installed and used together, requiring only minor changes to existing TomoPy scripts. Furthermore, it is shown that the efficient GPU-based reconstruction methods of the ASTRA toolbox can significantly decrease the time needed to reconstruct large datasets, and that advanced reconstruction methods can improve reconstruction quality compared with TomoPy's standard reconstruction method.

Pelt, Daniël M.↗

Subterahertz collective dynamics of polar vortices

The collective dynamics of topological structures are of interest from both fundamental and applied perspectives. For example, studies of dynamical properties of magnetic vortices and skyrmions have not only deepened our understanding of many-body physics but also offered potential applications in data processing and storage. Topological structures constructed from electrical polarization, rather than electron spin, have recently been realized in ferroelectric superlattices, and these are promising for ultrafast electric-field control of topological orders. However, little is known about the dynamics underlying the functionality of such complex extended nanostructures. In this study, using terahertz-field excitation and femtosecond X-ray diffraction measurements, we observe ultrafast collective polarization dynamics that are unique to polar vortices, with orders-of-magnitude higher frequencies and smaller lateral size than those of experimentally realized magnetic vortices. A previously unseen tunable mode, hereafter referred to as a vortexon, emerges in the form of transient arrays of nanoscale circular patterns of atomic displacements, which reverse their vorticity on picosecond timescales. Its frequency is considerably reduced (softened) at a critical strain, indicating a condensation (freezing) of structural dynamics. We use first-principles-based atomistic calculations and phase-field modelling to reveal the microscopic atomic arrangements and corroborate the frequencies of the vortex modes. The discovery of subterahertz collective dynamics in polar vortices opens opportunities for electric-field-driven data processing in topological structures with ultrahigh speed and density.

36 MATERIALS SCIENCE↗

Adaptive methods of generating complex light arrays

Structured light arrays of various shapes have been a cornerstone in optical science, driven by the complexities of precise and adaptable generation. This study introduces an approach using a spatial light modulator (SLM) as a generator for these arrays. By projecting a holographic mask onto the SLM, it functions simultaneously as an optical convolution device, focusing mechanism, and structured light beam mask. Our approach offers unmatched versatility, allowing for the experimental fabrication of traditional beam arrays like azimuthal Laguerre–Gaussian (LG), Bessel–Gaussian (BG), and Hermite–Gauss (HG) in the far-field. Notably, it has enabled a method of generating Ince–Gauss (IG) and LG radial mode beam arrays using a convolution solution. Our system provides exceptional control over array periodicity and intensity distribution, bypassing the Talbot self-imaging phenomenon seen in traditional setups. We provide an in-depth theoretical discussion, supported by empirical evidence, of our far-field results. This method has vast potential for applications in optical communication, data processing, and multi-particle manipulation. It paves the way for rapid generation of structured light with high spatial frequencies and complex shapes, promising transformative advances in these domains.

Optics↗

Sensing Electrical Networks Securely & Economically (SENSE)

The growing adoption of distributed energy resources (DERs) like battery energy storage systems and roof top solar/PV and the rapid penetration of electric vehicles (EVs), the electric grid is undergoing a major transformation with elevated stress on legacy grid assets. Despite a lot of expenditure to address these challenges, both in dollars and manpower, utilities have not been able to receive the value that was promised. The gains have been most visible at the transmission and substation level, especially where the main objective was improving operational and economic efficiency for the utility. Improving visibility and control at a few select points enhances the existing and established paradigm of centralized command and control. With changing load patterns, load types and the overall transition to an “active grid”, the centralized control and coordination paradigm gets challenged. To address the challenges, a new architecture and mechanism is needed, one that supports decentralized control and decision making, extracting value streams at the grid edge, particularly as the changes are fueled by transitions occurring in the distribution system. To address this, a communications and data processing platform, “GAMMA” was developed and demonstrated through the project. At the heart of the platform, are distributed, intelligent edge nodes with sensing and compute capabilities, that can record and analyze information locally. They are embedded in sensors and actuators specific to different distribution system applications. Phase 1 of the project focused on developing novel sensor technology that can be used for monitoring utility pole top distribution transformers. The sensors were designed with the objective of being low-cost, communicating with the GAMMA cloud using novel “delay-tolerant” networking using Bluetooth and a secure mobile application. They were non-intrusive in nature so that they can be installed quickly in the field, resulting in overall low cost of deployment and operations. Following the successful completion of Phase 1, the team manufactured 100 units for a field demonstration in Phase 2. The field demonstration was carried out on two real feeder systems with the local utility partner. In total, 100 sensors were installed and operated over a period of 6 months in the state of Georgia. The platform is operational end to end, with the cloud infrastructure deployed on a distributed, serverless environment that can serve multiple data streams, an analytics engine and a portal to securely view the data from multiple assets. The data collected through the GAMMA Mobile Phone app showcased the viability of the novel delay tolerant networking architecture, and the data processing algorithms developed through the course of the project, were successful in extracting important information about the overall network, improving the utility’s visibility and situational awareness in the distribution feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Scattering of a laser beam on a wet blood smear and measurement of red cell size distribution

We report an automated laser system that allows the red cell size distribution to be measured. Experiments are performed on laser light scattering by a suspension of oriented red blood cells (a wet blood smear). Based on an analysis of the angular distribution of light intensity in the diffraction pattern, we have restored the red cell size distribution. The average diameter of a red blood cell is determined with an error of less than 1%, and the spread of red blood cells in size – with an error of about 20%. We discuss the problems of photometry and processing of diffraction patterns, preparing blood samples and data processing algorithms, including methods for solving the inverse scattering problem. (laser biophotonics)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The AXEAP2 program for K β X-ray emission spectra analysis using artificial intelligence

The processing and analysis of synchrotron data can be a complex task, requiring specialized expertise and knowledge. Our previous work addressed the challenge of X-ray emission spectrum (XES) data processing by developing a standalone application using unsupervised machine learning. However, the task of analyzing the processed spectra remains another challenge. Although the non-resonant K β XES of 3 d transition metals are known to provide electronic structure information such as oxidation and spin state, finding appropriate parameters to match experimental data is a time-consuming and labor-intensive process. Here, a new XES data analysis method based on the genetic algorithm is demonstrated, applying it to Mn, Co and Ni oxides. This approach is also implemented as a standalone application, Argonne X-ray Emission Analysis 2 ( AXEAP2 ), which finds a set of parameters that result in a high-quality fit of the experimental spectrum with minimal intervention. AXEAP2 is able to find a set of parameters that reproduce the experimental spectrum, and provide insights into the 3 d electron spin state, 3 d –3 p electron exchange force and K β emission core-hole lifetime.

36 MATERIALS SCIENCE↗

Design and implementation of a portable diagnostic system for Thomson scattering and optical emission spectroscopy measurements

A diagnostic system, which has a design goal of high-portability, has been designed at Oak Ridge National Laboratory (ORNL). This project aims at providing measurements of key plasma parameters (ne, Te, ni, Ti) for fusion-relevant devices, utilizing Thomson scattering (TS) and optical emission spectroscopy (OES). The innovative design employs mostly commercial off-the-shelf instrumentation and a traveling team of researchers to conduct measurements at various magnetic-confinement plasma devices. The TS diagnostic uses a Quantel Q-smart 1500 Nd:YAG laser with a 2ω harmonic generator to produce up to 850 mJ of 532 nm laser pulses at 10 Hz. Collection optics placed at the detection port consists of an 11 × 3 optical fiber bundle, where the TS diagnostic uses an 11 × 1 subset array of the fibers, the OES diagnostic uses another 11 fibers, and the remaining fibers are available to the host institution. The detection system is comprised of two separate IsoPlane-320 spectrometers with triple-grating turrets of various line spacing and two PI-MAX 4 intensified CCD detectors, used simultaneously to measure a broad range of ion, impurity, and electron parameters. The self-contained diagnostic package also includes a data processing and storage system. The design and initial implementation of the TS-OES diagnostic system are described. The experiments from the proof-of-principle operation of the portable package on a high density (∼2.5 × 1022 m−3) and low-temperature (∼5 eV) electrothermal arc source at ORNL are also discussed.

Kafle, N. (ORCID:000000028144787X)↗

Optimization of an enclosed gas analyzer sampling system for measuring eddy covariance fluxes of H 2 O and CO 2

Several initiatives are currently emerging to observe the exchange of energy and matter between the earth's surface and atmosphere standardized over larger space and time domains. For example, the National Ecological Observatory Network (NEON) and the Integrated Carbon Observing System (ICOS) are set to provide the ability of unbiased ecological inference across ecoclimatic zones and decades by deploying highly scalable and robust instruments and data processing. In the construction of these observatories, enclosed infrared gas analyzers are widely employed for eddy covariance applications. While these sensors represent a substantial improvement compared to their open- and closed-path predecessors, remaining high-frequency attenuation varies with site properties and gas sampling systems, and requires correction. Here, we show that components of the gas sampling system can substantially contribute to such high-frequency attenuation, but their effects can be significantly reduced by careful system design. From laboratory tests we determine the frequency at which signal attenuation reaches 50 % for individual parts of the gas sampling system. For different models of rain caps and particulate filters, this frequency falls into ranges of 2.5–16.5 Hz for CO 2 , 2.4–14.3 Hz for H 2 O, and 8.3–21.8 Hz for CO 2 , 1.4–19.9 Hz for H 2 O, respectively. A short and thin stainless steel intake tube was found to not limit frequency response, with 50 % attenuation occurring at frequencies well above 10 Hz for both H 2 O and CO 2 . From field tests we found that heating the intake tube and particulate filter continuously with 4 W was effective, and reduced the occurrence of problematic relative humidity levels (RH > 60 %) by 50 % in the infrared gas analyzer cell. No further improvement of H 2 O frequency response was found for heating in excess of 4 W. These laboratory and field tests were reconciled using resistor–capacitor theory, and NEON's final gas sampling system was developed on this basis. The design consists of the stainless steel intake tube, a pleated mesh particulate filter and a low-volume rain cap in combination with 4 W of heating and insulation. In comparison to the original design, this reduced the high-frequency attenuation for H 2 O by ≈ 3/4, and the remaining cospectral correction did not exceed 3 %, even at high relative humidity (95 %). The standardized design can be used across a wide range of ecoclimates and site layouts, and maximizes practicability due to minimal flow resistance and maintenance needs. Lastly, due to minimal high-frequency spectral loss, it supports the routine application of adaptive correction procedures, and enables largely automated data processing across sites.

54 ENVIRONMENTAL SCIENCES↗

Rotation-Enabled 7-Degree of Freedom Seismometer for Geothermal Resource Development. Phase 1 Final Report

Under this Department of Energy (DOE) grant, A-Tech Corporation d.b.a. Applied Technology Associates (ATA), seeks to develop a seven-degree-of-freedom (7-DOF) seismic measurement tool for high-temperature geothermal applications. The Rotational-Enabled 7-DOF Seismometer includes a conventional tri-axial accelerometer, a conventional pressure sensor or hydrophone, and a tri-axial rotational sensor. The rotational sensing capability is novel, based upon ATA's innovative research in rotational sensing technologies. The geothermal industry requires tools for high-precision seismic monitoring of crack formation associated with Enhanced Geothermal System (EGS) stimulation activity. Currently, microseismic monitoring is conducted by deploying many seismic tools at different depth levels along a 'string' within drilled observation wells. Costs per string can be hundreds of thousands of dollars. Processing data from the spatial arrays of linear seismometers allows back-projection of seismic wave states. In contrast, a Rotational-Enabled 7-DOF Seismometer would simultaneously measure p-wave velocity, s-wave velocity, and incident seismic wave direction all from a single point measurement. In addition, the Rotational-Enabled 7-DOF Seismometer will, by its nature, separate p- and s-waves into different data streams, simplifying signal processing and facilitating analysis of seismic source signatures and geological characterization. By adding measurements of three additional degrees-of-freedom at each level and leveraging the information from this new seismic observable, it is likely that an equally accurate picture of subsurface seismic activity could be garnered with fewer levels per hole. The key cost savings would come from better siting of the well due to increased information content and a decrease in the number of confirmation wells drilled, also due to the increase in information per well. Improved seismic tools may also increase knowledge, understanding, and confidence, thus removing some current blocks to feasibility and significantly increasing access to potential geothermal sites. During the Phase 1 effort summarized in this final report, the ATA Team modeled and built two TRL 3 proof-of-concept test units for two competing rotational sensor technologies. The two competing technologies were based on ATA's angular rate and angular displacement measurement technologies; Angular rate: ATA's Magnetohydrodynamic Angular Rate Sensor (Seismic MHD); and Angular displacement: ATA's Low Frequency Improved Torsional Seismometer (LFITS). In order to down-select between these two technologies and formulate a go / no go decision, the ATA Team analyzed and traded scientific performance requirements and market constraints against sensor characteristics and components, acquiring field data where possible to validate the approach and publishing results from these studies of rotational technology capability. Based on the results of Phase 1, the ATA Team finds that the Seismic MHD (SMHD) technology is the best choice for enabling rotational seismometry and significant technical potential exists for micro-seismic monitoring using a downhole 7-DOF device based on the SMHD. Recent technical papers and field data confirm the potential of rotational sensing for seismic mapping, increasing confidence that cost-reduction benefits are achievable for EGS. However, the market for geothermal rotational sensing is small and undeveloped. As a result, this report recommends modifying the Phase 2 plan to focus on prototype development aimed at partnering with early adopters within the geothermal industry and the scientific research community. The highest public benefit will come from development and deployment of a science-grade SMHD rotational seismometer engineered for geothermal downhole conditions and an integrated test tool for downhole measurements at active geothermal test sites.

15 GEOTHERMAL ENERGY↗