Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Data Processing Pipeline To Extract A Knowledge Graph From Sec Documents For Socio-technical Analysis Of Critical Infrastructure Influence

The code is written in Python and consists of the following pipeline that is implemented in Apache Airflow. This pipeline intends to understand the companies that are directly or indirectly involved with a type of critical infrastructure system at some point in that system's lifecycle. The pipeline takes a configuration file that specifies a list of initial companies to consider, a geographic region of interest (disk) expressed as a latitude/longitude point and distance, and a set of SEC form types from which to extract entities and relations. There are three main components to this pipeline as currently implemented: Social Network Extraction, Critical Infrastructure Network Extraction, and Inference and Fusion. First, Social Network Extraction, implemented as the `organizations_sec` component of the workflow graph queries the SEC EDGAR webservice using the list of initial companies from the configuration file. Given this, it extracts metadata that documents the number of each type of form for the given set of companies and their location. This forms metadata represents a catalog of data sources for the extracted social network knowledge graph. The pipeline then downloads these forms from the website and saves them in a build directory for further processing. These documents are then parsed for entities and relations. Second, the Critical Network Extraction component extracts entities and relations for a critical infrastructure sector. Currently, we focus on Electric Vehicle charging stations and this information is available via the Department of Energy (DOE) database on fueling stations maintained by NREL. Third, the Inference and Fusion component relates the social network graph to the critical infrastructure graph in order to understand the impact of a company within a geographic region. Relations include ownership of the EV Charging Station asset as well as maintenance/ownership of the EV payment networks. The fused network can be represented in many ways and currently we emit a knowledge graph.

Weaver, GabrielA.↗
DOE OSTI2023

X-Ray Scattering Data Processing and Analysis

Semicrystalline polymers have a degree of crystallinity that depends on chain structure and crystallization conditions. Thermomechanical properties are influenced by the degree of crystallinity and crystalline morphology. A common method used to understand crystalline content, crystal and amorphous layer thickness, and layer thickness distributions, is X-ray scattering (XS). This report uses XS to first investigate crystalline orientation in high density polyethylene (HDPE) samples. Then, a single orientation is analyzed via XS in a temperature study to investigate crystalline behavior under changing temperatures. Lastly, block copolymer filaments extruded at varying speeds are analyzed. The X-ray data are used to gain a baseline understanding of crystalline behavior in these unique filaments.

36 MATERIALS SCIENCE↗
DOE OSTI2024

WFIP3 High Frequency Radar / Processed Data

These data were collected by Kirincich as part of the DOE Wind Forecast Improvement Project, based on support from NOAA-IOOS, WHOI, and DOE. The data consist of estimates of the near-surface horizontal (East and North) ocean currents made via High Frequency (HF) radar-based remote sensing of the Ocean backscatter spectrum. The effective measurement depth of the WHOI HF radars is 0.5 m below the ocean surface. The WHOI HF radar system, as operated during the experiment, consisted of 4 land-based sites spaced at 30-40km intervals along the area spanning from Nantucket,MA to Narragansett,RI that operate at 16 MHz and 25 MHz systems (see Kirincich et al, 2019 and Kirincich et al 2022 for details). Received doppler spectra from each were processed using the advanced methods of Kirincich et al. 2012, and Kirincich et al 2019, and unpublished work Kirincich, 2024) into radial or elliptical velocity estimates every 30 min based on a 30 min averaging window.

17 WIND ENERGY↗
DOE OSTI2015

Hybrid Statistical Testing for Nuclear Material Accounting Data and/or Process Monitoring Data

The two tests employed in the hybrid testing scheme are Page’s cumulative sums for all streams within a Balance Period (maximum of the maximums and average of the maximums) and Crosier’s multivariate cumulative sum applied to incremental cumulative sums across Balance Periods. The role of residuals for both kinds of data is discussed.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2012

Incorporating Semantic Knowledge into Dynamic Data Processing for Smart Power Grids

Semantic Web allows us to model and query time-invariant or slowly evolving knowledge using ontologies. Emerging applications in Cyber Physical Systems such as Smart Power Grids that require continuous information monitoring and integration present novel opportunities and challenges for Semantic Web technologies. Semantic Web is promising to model diverse Smart Grid domain knowledge for enhanced situation awareness and response by multi-disciplinary participants. However, current technology does pose a performance overhead for dynamic analysis of sensor measurements. In this paper, we combine semantic web and complex event processing for stream based semantic querying. We illustrate its adoption in the USC Campus Micro-Grid for detecting and enacting dynamic response strategies to peak power situations by diverse user roles. We also describe the semantic ontology and event query model that supports this. Further, we introduce and evaluate caching techniques to improve the response time for semantic event queries to meet our application needs and enable sustainable energy management.

Zhou, Qunzhi↗
DOE OSTI2018

Antarctic Cloud Macrophysical, Thermodynamic Phase, and Atmospheric Inversion Coupling Properties at McMurdo Station: I. Principal Data Processing and Climatology

Polar cloud radiative forcing plays a crucial role in the determination of the surface and atmospheric energy balance through processes which are not yet fully understood. While there is a broad and fairly complete database of cloud measurements from several Arctic sites and field campaigns through the past two decades, the recent one-year long U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) West Antarctic Radiation Experiment (AWARE) field campaign at McMurdo Station has provided a hitherto unmatched multiple-instrument set of ground-based Antarctic cloud measurements. These observations are processed and used to derive the main cloud and liquid containing layer properties: occurrence fraction, cloud persistence and boundaries, and configuration relative to temperature and moisture inversions. The results are compared to previous Arctic observations. It is concluded that clouds and liquid-bearing layers over McMurdo Station are essentially less prevalent and persistent than their Arctic counterparts. Furthermore, they typically have higher bases and show a weaker temperature dependence than in the Arctic, suggesting a more pristine Antarctic atmosphere. In addition, the clouds (including both water phases) typically extend toward relatively lower altitudes, and their relation to inversions near cloud top is often similar to those observed in the Arctic.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Ex situ metrology and data processing techniques developed at the ALS for optimization of beamline performance of bendable x-ray mirrors

We discuss experimental, analytical, and numerical methods recently developed at the Advanced Light Source (ALS) X?Ray Optics Laboratory (XROL) for calibration and precision shaping of bendable x-ray mirrors. The methods are based on ex situ measurements with the mirrors using surface slope profilers available at the ALS XROL. The first realization of methods and dedicated software has allowed the optimization of the beamline performance of bendable mirrors by adjustment of the mirror shape to minimize the root-mean-square variation of residual (after subtraction of the ideal desired shape) slope deviations from ideal (specified) surface figure. Here, we further develop the methods that in application to elliptically bent mirrors adapt as a figure of merit the minimum of the rms size of the focused beam. The efficacy of the developed methods is demonstrated with examples of optimal tuning of an elliptically bendable cylindrical mirror designed for the ALS beamline 10.3.2.

Yashchuk, VV↗