Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data streams”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

A Data Filter for Identifying Steady-State Operating Points in Engine Flight Data for Condition Monitoring Applications

This paper presents an algorithm that automatically identifies and extracts steady-state engine operating points from engine flight data. It calculates the mean and standard deviation of select parameters contained in the incoming flight data stream. If the standard deviation of the data falls below defined constraints, the engine is assumed to be at a steady-state operating point, and the mean measurement data at that point are archived for subsequent condition monitoring purposes. The fundamental design of the steady-state data filter is completely generic and applicable for any dynamic system. Additional domain-specific logic constraints are applied to reduce data outliers and variance within the collected steady-state data. The filter is designed for on-line real-time processing of streaming data as opposed to post-processing of the data in batch mode. Results of applying the steady-state data filter to recorded helicopter engine flight data are shown, demonstrating its utility for engine condition monitoring applications.

Simon, Donald L.↗

Massively parallel processor computer

An apparatus for processing multidimensional data with strong spatial characteristics, such as raw image data, characterized by a large number of parallel data streams in an ordered array is described. It comprises a large number (e.g., 16,384 in a 128 x 128 array) of parallel processing elements operating simultaneously and independently on single bit slices of a corresponding array of incoming data streams under control of a single set of instructions. Each of the processing elements comprises a bidirectional data bus in communication with a register for storing single bit slices together with a random access memory unit and associated circuitry, including a binary counter/shift register device, for performing logical and arithmetical computations on the bit slices, and an I/O unit for interfacing the bidirectional data bus with the data stream source. The massively parallel processor architecture enables very high speed processing of large amounts of ordered parallel data, including spatial translation by shifting or sliding of bits vertically or horizontally to neighboring processing elements.

Fung, L. W.↗

AFTI/F-111 airplane mission adaptive wing operational flight evaluation technique using uplinked pilot command cues

NASA and the USAF have conducted a program to investigate aircraft performance improvements utilizing a mission adaptive wing (MAW). The MAW was designed and developed for the AFTI/F-111 variable-sweep aircraft to provide a hydraulically driven, smooth, and continuous variable camber of the trailing and leading edges as a function of maneuvering requirements or of flight conditions. The remotely augmented vehicle facility (RAV) at the NASA DFRF, as utilized in the MAW investigations, is described. The RAV was a dedicated, ground based, general purpose facility capable of receiving a data stream downlinked from a test vehicle, processing this data stream in a digital computer, and transmitting processed data back to the test vehicle. It is shown that this method of flight testing provides a technique that can evaluate highly dynamic maneuvers.

Kempel, Robert W.↗

General Mode Scanning Probe Microscopy

A critical part of SPM measurements is the information transfer from the probe-sample junction to the measurement system. Current information transfer methods heavily compress the information-rich data stream by averaging the data over a time interval, or via heterodyne detection approaches such as lock-in amplifiers and phase-locked loops. As a consequence, highly valuable information at the sub-microsecond time scales or information from frequencies outside the measurement band is lost. We have developed a fundamentally new approach called General Mode (G-mode), where we can capture the complete information stream from the detectors in the microscope. The availability of the complete information allows the microscope operator to analyze the data via information-theory analysis or comprehensive physical models. Furthermore, the complete data stream enables advanced data-driven filtering algorithms, multi-resolution imaging, ultrafast spectroscropic imaging, spatial mapping of multidimensional variability in material properties, etc. Though we applied this approach to scanning probe microscopy, the general philosophy of G-mode can be applied to many other modes of microscopy. G-mode data is captured by completely custom software written in LabVIEW and Matlab. The software generates the waveforms to electrically, thermally, or mechanically excite the SPM probe. It handles real-time communications with the microscope software for operations such as moving the SPM probe position and also controls other instrumentation hardware. The software also controls multiple variants of high-speed data acquisition cards to excite the SPM probe with the excitation waveform and simultaneously measure multiple channels of information from the microscope detectors at sampling rates of 1-100 MHz. The software also saves the raw data to the computer and allows the microscope operator to visualize processed or filtered data during the experiment. The software performs all these features while offering a user-friendly interface.

Somnath, Suhas↗

Data Center Facility Monitoring with Physics Aware Approach

U.S. Department of Energy's National Renewable Energy Laboratory (NREL) hosts one of the world's most energy-efficient HPC data centers; this system uses component-level warm-water liquid cooling to efficiently remove heat from the data center and capture it for reuse in the building or rejection to the atmosphere. Given the complexity of this system, building data-driven tools for holistically monitoring and operating the entire data center is a priority for ensuring maximal efficiency and resiliency. In this advanced smart facility, over one million metrics are recorded per minute using state-of-the-art streaming data architecture and software to capture and process the state of the system in real time. Here we detail two efforts to effectively analyze, visualize, and interpret this large volume streaming data. We have developed a novel, flexible system for identifying and visualizing individual metric anomalies and component performance across the data center through automatic metadata extraction and physically-motivated visualization for quick interpretation. Additionally, to directly connect system maintenance to data stream processing we explore a physics informed multi-metric drift and anomaly detection application to detect scale-build up in heat exchangers.

anomaly detection↗

Minimum shift keying based protection mode capable wavelength division multiplexed passive optical network optical overlay system

We explored the functioning of an optical overlay of multicast and unicast data streams on a survival wavelength division multiplexed passive optical network using intensity and minimum shift keying modulation for both single and multiuser. In optical line terminal, using a sinusoidal clock, optical subcarriers are generated not only to carry the multicast and unicast data streams simultaneously but also in case of fiber failure, protection mode is enabled to carry the data streams smoothly. Here, 10 Gbps downstream multicast in normal mode and unicast signals both in normal and protection mode are transmitted error-free through 30 km dispersion shifted fiber. In both the cases 10 Gbps upstream signal is modulated and sent back to the optical line terminal. For single user nearly similar power penalty is witnessed for downstream unicast as well as re-modulated upstream data in both the conditions and also when multicast data is disabled. The power penalties between single and multiuser for both the modes are found to be approximately 0.06, 0.42 and 0.7 dB for unicast MSK, multicast and upstream respectively.

36 MATERIALS SCIENCE↗

NASA ground terminal communication equipment automated fault isolation expert systems

The prototype expert systems are described that diagnose the Distribution and Switching System I and II (DSS1 and DSS2), Statistical Multiplexers (SM), and Multiplexer and Demultiplexer systems (MDM) at the NASA Ground Terminal (NGT). A system level fault isolation expert system monitors the activities of a selected data stream, verifies that the fault exists in the NGT and identifies the faulty equipment. Equipment level fault isolation expert systems are invoked to isolate the fault to a Line Replaceable Unit (LRU) level. Input and sometimes output data stream activities for the equipment are available. The system level fault isolation expert system compares the equipment input and output status for a data stream and performs loopback tests (if necessary) to isolate the faulty equipment. The equipment level fault isolation system utilizes the process of elimination and/or the maintenance personnel's fault isolation experience stored in its knowledge base. The DSS1, DSS2 and SM fault isolation systems, using the knowledge of the current equipment configuration and the equipment circuitry issues a set of test connections according to the predefined rules. The faulty component or board can be identified by the expert system by analyzing the test results. The MDM fault isolation system correlates the failure symptoms with the faulty component based on maintenance personnel experience. The faulty component can be determined by knowing the failure symptoms. The DSS1, DSS2, SM, and MDM equipment simulators are implemented in PASCAL. The DSS1 fault isolation expert system was converted to C language from VP-Expert and integrated into the NGT automation software for offline switch diagnoses. Potentially, the NGT fault isolation algorithms can be used for the DSS1, SM, amd MDM located at Goddard Space Flight Center (GSFC).

Tang, Y. K.↗

Real-time GIS Programming and Geocomputation

Streaming data generated continuously from sensor networks, mobile devices, social media platforms and other edge devices have posed significant challenges to existing computing platforms for achieving both high throughput and low latency data processing in addition to scalable computing. This entry introduces a real-time computing and programming platform for time-critical GIS (Geographic Information System) applications. In this platform, advanced streaming data processing software, such as Apache Kafka and Spark Streaming, are integrated to enable data analytics in real-time. This computing platform can also be extended to integrate GeoAI (Geospatial Artificial Intelligence) based machine learning models to leverage both historical and streaming data to achieve real-time prediction and intelligent geospatial analytics. Two real-time geospatial applications in terms of flood simulation and climate data visualization are introduced to demonstrate how real-time programming and computing can help tackle real-world problems with important societal impacts.

Liu, Yan↗

Continual learning in the presence of repetition

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not often considered in standard benchmarks for CL. Unlike with the rehearsal mechanism in buffer-based strategies, where sample repetition is controlled by the strategy, repetition in the data stream naturally stems from the environment. This report provides a summary of the CLVision challenge at CVPR 2023, which focused on the topic of repetition in class-incremental learning. The report initially outlines the challenge objective and then describes three solutions proposed by finalist teams that aim to effectively exploit the repetition in the stream to learn continually. The experimental results from the challenge highlight the effectiveness of ensemble-based solutions that employ multiple versions of similar modules, each trained on different but overlapping subsets of classes. This report underscores the transformative potential of taking a different perspective in CL by employing repetition in the data stream to foster innovative strategy design.

Class-incremental learning↗

AGR-2 Data Qualification Report for ATR Cycle 154B

This report provides the data qualification status of Advanced Gas Reactor-2 (AGR-2) fuel irradiation experimental data from Advanced Test Reactor (ATR) Cycle 154B as recorded in the Nuclear Data Management and Analysis System (NDMAS). This is the last cycle of AGR-2 irradiation, as the test train was pulled from the ATR core during the outage portion of ATR Cycle 155A. The AGR-2 data streams addressed in this report include thermocouple (TC) temperatures, sweep gas data (flow rates including new Fission Product Monitoring (FPM) downstream flows from Fission Product Monitoring System (FPMS) detectors, pressure, and moisture content), and FPMS data (release rates and release-to-birth rate ratios [R/Bs]) for each of the six capsules in the AGR-2 experiment. The final data qualification status for these data streams is determined by a Data Review Committee (DRC) comprised of AGR technical leads, Sitewide Quality Assurance (QA), and NDMAS analysts. The Data Review Committee reviewed the data acquisition process, considered whether the data met the requirements for data collection as specified in QA-approved Very High Temperature Reactor (VHTR) data collection plans, examined the results of NDMAS data testing and statistical analyses, and confirmed the qualification status of the data as given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

AGR-3/4 Data Qualification Report for ATR Cycles 151A, 151B, 152A, 152B, 154A, and 154B

This data report provides the qualification status of Advanced Gas Reactor-3/4 (AGR-3/4) fuel irradiation experimental data from Advanced Test Reactor (ATR) Cycles 151A, 151B, 152A, 152B, 154A, and 154B, as recorded in the Nuclear Data Management and Analysis System (NDMAS). Of these cycles, ATR Cycle 152A is a low power cycle that occurred when the ATR core was briefly at low power. The irradiation data are not used for physics and thermal calculation, but the qualification status of these cycle data is still covered in this report. On the other hand, during ATR Cycles 153A (unplanned Outage cycle) and 153B (Power Axial Locator Mechanism [PALM] cycle), the AGR-3/4 was pulled out from the ATR core and stored in the canal to avoid being overheated. Therefore, qualification of the AGR-3/4 irradiation data from these 2 cycles was excluded in this report. By the end of ATR Cycle 154B, AGR-3/4 was irradiated for a total of 264.1 effective full power days. The AGR-3/4 data streams addressed in this report include thermocouple (TC) temperatures, sweep gas data (flow rates, pressure, and moisture content), and Fission Product Monitoring System (FPMS) data (release rates and release-to-birth rate ratios [R/Bs]) for each of the twelve capsules in the AGR-3/4 experiment. The final data qualification status for these data streams is determined by a Data Review Committee (DRC) composed of AGR technical leads, Sitewide Quality Assurance (QA), and NDMAS analysts. The DRC convened on February 12, 2014, reviewed the data acquisition process, and considered whether the data met the requirements for data collection as specified in QA-approved Very High Temperature Reactor (VHTR) Technology Development Office (TDO) data collection plans. The DRC also examined the results of NDMAS data testing and statistical analyses, and confirmed the qualification status of the data as given in this report.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

AGR-3/4 Final Data Qualification Report for ATR Cycles 151A through 155B-1

This report provides the qualification status of experimental data for the entire Advanced Gas Reactor 3/4 (AGR 3/4) fuel irradiation. AGR-3/4 is the third in a series of planned irradiation experiments conducted in the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL) for the AGR Fuel Development and Qualification Program, which supports development of the advanced reactor technology under the INL ART Technology Development Office (TDO). The main objective of AGR-3/4 irradiation is to provide a known source of fission products for subsequent transport through compact matrix and structural graphite materials due to the presence of designed-to-fail fuel particles. Full power irradiation of the AGR 3/4 test began on December 14, 2011 (ATR Cycle 151A), and was completed on April 12, 2014 (end of ATR Cycle 155B) after 369.1 effective full power days of irradiation. The AGR-3/4 test was in the reactor core for eight of the ten ATR cycles between 151A and 155B. During the unplanned outage cycle, 153A, the experiment was removed from the ATR northeast flux trap (NEFT) location and stored in the ATR canal. This was to prevent overheating of fuel compacts due to higher than normal ATR power during the subsequent Powered Axial Locator Mechanism cycle, 153B. The AGR 3/4 test was inserted back into the ATR NEFT location during the outage of ATR Cycle 154A on April 26, 2013. Therefore, the AGR-3/4 irradiation data received during these 2 cycles (153A and 153B) are irrelevant and their qualification status isnot included in this report. Additionally, during ATR Cycle 152A the ATR core ran at low power for a short enough duration that the irradiation data are not used for physics and thermal calculations. However, the qualification status of irradiation data for this cycle is still covered in this report. As a result, this report includes data from 8 ATR Cycles: 151A, 151B, 152A, 152B, 154A, 154B, 155A, and 155B, as recorded in the Nuclear Data Management and Analysis System (NDMAS). The AGR 3/4 data streams addressed in this report include thermocouple (TC) temperatures, sweep gas data (flow rates, pressure, and moisture content), and Fission Product Monitoring System (FPMS) data (release rates, release to birth rate ratios [R/Bs], and particle failure counts) for each of the twelve capsules in the AGR 3/4 experiment. During Outage Cycle 155A, fourteen flow meters were installed downstream from fourteen FPMS monitors to measure flows from the monitors; qualification status of these data are also included in the report. The final data qualification status for these data streams is determined by a Data Review Committee (DRC) composed of AGR technical leads, Sitewide Quality Assurance (QA), and NDMAS analysts. For ATR Cycles 151A through 154B, the DRC convened on February 12, 2014, reviewed the data acquisition process, and considered whether the data met the requirements for data collection as specified in QA approved INL ART TDO data collection plans. The DRC also examined the results of NDMAS data testing and statistical analyses, and confirmed the qualification status of the data as given in this report. The qualification status of AGR-3/4 irradiation data during the first six cycles were previously reported in INL/EXT-14-31186 document. This report presents data qualification status for the entire AGR-3/4 irradiation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Alternative Vegetation States in Tropical Forests and Savannas: The Search for Consistent Signals in Diverse Remote Sensing Data

Globally, the spatial distribution of vegetation is governed primarily by climatological factors (rainfall and temperature, seasonality, and inter-annual variability). The local distribution of vegetation, however, depends on local edaphic conditions (soils and topography) and disturbances (fire, herbivory, and anthropogenic activities). Abrupt spatial or temporal changes in vegetation distribution can occur if there are positive (i.e., amplifying) feedbacks favoring certain vegetation states under otherwise similar climatic and edaphic conditions. Previous studies in the tropical savannas of Africa and other continents using the MODerate Resolution Imaging Spectroradiometer (MODIS) vegetation continuous fields (VCF) satellite data product have focused on discontinuities in the distribution of tree cover at different rainfall levels, with bimodal distributions (e.g., concentrations of high and low tree cover) interpreted as alternative vegetation states. Such observed bimodalities over large spatial extents may not be evidence for alternate states, as they may include regions that have different edaphic conditions and disturbance histories. In this study, we conduct a systematic multi-scale analysis of diverse MODIS data streams to quantify the presence and spatial consistency of alternative vegetation states in Sub-Saharan Africa. The analysis is based on the premise that major discontinuities in vegetation structure should also manifest as consistent spatial patterns in a range of remote sensing data streams, including, for example, albedo and land surface temperature (LST). Our results confirm previous observations of bimodal and multimodal distributions of estimated tree cover in the MODIS VCF. However, strong disagreements in the location of multimodality between VCF and other data streams were observed at 1 km scale. Results suggest that the observed distribution of VCF over vast spatial extents are multimodal, not because of local-scale feedbacks and emergent bifurcations (the definition of alternative states), but likely because of other factors including regional scale differences in woody dynamics associated with edaphic, disturbance, and/or anthropogenic processes. These results suggest the need for more in-depth consideration of bifurcation mechanisms and thus the likely spatial and temporal scales at which alternative states driven by different positive feedback processes should manifest.

Savanna↗

Portable Airborne Laser System Measures Forest-Canopy Height

(PALS) is a combination of laser ranging, video imaging, positioning, and data-processing subsystems designed for measuring the heights of forest canopies along linear transects from tens to thousands of kilometers long. Unlike prior laser ranging systems designed to serve the same purpose, the PALS is not restricted to use aboard a single aircraft of a specific type: the PALS fits into two large suitcases that can be carried to any convenient location, and the PALS can be installed in almost any local aircraft for hire, thereby making it possible to sample remote forests at relatively low cost. The initial cost and the cost of repairing the PALS are also lower because the PALS hardware consists mostly of commercial off-the-shelf (COTS) units that can easily be replaced in the field. The COTS units include a laser ranging transceiver, a charge-coupled-device camera that images the laser-illuminated targets, a differential Global Positioning System (dGPS) receiver capable of operation within the Wide Area Augmentation System, a video titler, a video cassette recorder (VCR), and a laptop computer equipped with two serial ports. The VCR and computer are powered by batteries; the other units are powered at 12 VDC from the 28-VDC aircraft power system via a low-pass filter and a voltage converter. The dGPS receiver feeds location and time data, at an update rate of 0.5 Hz, to the video titler and the computer. The laser ranging transceiver, operating at a sampling rate of 2 kHz, feeds its serial range and amplitude data stream to the computer. The analog video signal from the CCD camera is fed into the video titler wherein the signal is annotated with position and time information. The titler then forwards the annotated signal to the VCR for recording on 8-mm tapes. The dGPS and laser range and amplitude serial data streams are processed by software that displays the laser trace and the dGPS information as they are fed into the computer, subsamples the laser range and amplitude data, interleaves the subsampled data with the dGPS information, and records the resulting interleaved data stream.

Nelson, Ross↗

Learning Global Proliferation Expertise Evolution Using AI-Driven Analytics and Public Information

Detecting and anticipating global proliferation expertise and capability evolution from unstructured, noisy, and incomplete public data streams is a highly desired, but extremely challenging task. Here, in this article, we present our pioneering data-driven approach to support the non-proliferation mission to detect and explain the evolution of proliferation expertise and capability development globally from terabytes of publicly available information (PAI), focusing on our knowledge extraction pipeline and descriptive analytics. We first discuss how we fuse nine open-source data streams, including multilingual data, to convert 4 TB of unstructured data to structured knowledge and encode dynamically evolving proliferation expertise representations—content and context graphs. For this, we rely on natural language processing (NLP) and deep learning (DL) models to perform information extraction, topic modeling, and distributed text representation (aka embedding) learning. We then present interactive, usable, and explainable descriptive analytics to refine domain knowledge and present it in a human-understandable form. Finally, we introduce future work avenues that will leverage our dynamic knowledge representations and descriptive analytics to enable predictive and prescriptive inferences to achieve real-time domain understanding and contextual reasoning about global proliferation expertise and capability evolution.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

SPRUCE S1 Bog Porewater, Groundwater, and Stream Chemistry Data: 2011-2013

This data set reports the chemistry of S1 bog porewater, outlet stream water, and groundwater from upland wells from 2011 through 2013. These data provide information for studies of the biogeochemical status of the bog and surrounding groundwater aquifer. Porewater samples were collected from one nest of 6 piezometers installed in a hollow in the south end of the S1 bog to characterize solute chemistry depth profiles. Peat porewater was collected from piezometers that opened at 0, 0.3, 0.5, 1, 2, and 3 m depths below hollow surfaces. Samples were collected weekly (2011) or monthly (2012 & 2013) when the samplers were not frozen (typically June – November). Stream water was sampled weekly (2011-2013) from the outlet of the S1 bog (located on the southern edge of the bog). Four groundwater wells located in the uplands of the S1 watershed were sampled monthly in 2013. Bog water level data are also reported for the S1 bog. Water samples were analyzed for pH, specific conductivity, nutrient concentrations (ammonium, nitrate, soluble reactive phosphorus, total nitrogen, total phosphorus), cation concentrations (calcium, potassium, magnesium, sodium, aluminum, iron, manganese, silicon, strontium), anion concentrations (chloride, sulfate), and total organic carbon concentrations. The experimental work is to be conducted in a Picea mariana [black spruce] – Sphagnum spp. bog forest in northern Minnesota, 40 km north of Grand Rapids, in the USDA Forest Service Marcell Experimental Forest (MEF).

54 ENVIRONMENTAL SCIENCES↗

Computer simulation results for PCM/PM/NRZ receivers in nonideal channels

This article studies, by computer simulations, the performance of deep-space telemetry signals that employ the pulse code modulation/phase modulation (PCM/PM) technique, using nonreturn-to-zero data, under the separate and combined effects of unbalanced data, data asymmetry, and a band-limited channel. The study is based on measuring the symbol error rate performance and comparing the results to the theoretical results presented in previous articles. Only the effects of imperfect carrier tracking due to an imperfect data stream are considered. The presence of an imperfect data stream (unbalanced and/or asymmetric) produces undesirable spectral components at the carrier frequency, creating an imperfect carrier reference that will degrade the performance of the telemetry system. Further disturbance to the carrier reference is caused by the intersymbol interference created by the band-limited channel.

Anabtawi, A.↗

Accelerating Data Acquisition, Reduction, and Analysis at the Spallation Neutron Source

ORNL operates the world's brightest neutron source, the Spallation Neutron Source (SNS). Funded by the US DOE Office of Basic Energy Science, this national user facility hosts hundreds of scientists from around the world, providing a platform to enable break-through research in materials science, sustainable energy, and basic science. While the SNS provides scientists with advanced experimental instruments, the deluge of data generated from these instruments represents both a big data challenge and a big data opportunity. For example, instruments at the SNS can now generate multiple millions of neutron events per second providing unprecedented experiment fidelity but leaving the user with a dataset that cannot be processed and analyzed in a timely fashion using legacy techniques. To address this big data challenge, ORNL has developed a near real-time streaming data reduction and analysis infrastructure. The Accelerating Data Acquisition, Reduction, and Analysis (ADARA) system provides a live streaming data infrastructure based on a high-performance publish subscribe system, in situ data reduction, visualization, and analysis tools, and integration with a high-performance computing and data storage infrastructure. ADARA allows users of the SNS instruments to analyze their experiment as it is run and make changes to the experiment in real-time and visualize the results of these changes. In this paper we describe ADARA, provide a high-level architectural overview of the system, and present a set of use-cases and real-world demonstrations of the technology.

Campbell, Stuart I↗