Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing and logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

RACORO long-term, systematic aircraft observations of boundary layer clouds

Our knowledge of boundary layer cloud processes is insufficient to resolve pressing scientific problems. Boundary layer clouds often have liquid-water paths (LWPs) less than 100 gm{sup 2}, which are defined here as being 'thin' Clouds with Low Optical Water Depths (CLOWD). This type of cloud is common globally, and the Earth's radiative energy balance is particularly sensitive to small changes in their optical properties. However, it is difficult to retrieve accurately their cloud properties via remote sensing because they are tenuous and often occur in partly cloudy skies. This interferes with our ability to obtain the routine, long-term statistics needed to improve their representation in climate models. To address this problem, in-situ data are needed to investigate cloud processes and to evaluate and refine existing retrieval algorithms. Coordinated by the ARM Aerial Facility (AAF), the Routine AAF CLOWD Optical Radiative Observations (RACORO) field campaign conducted long-term, systematic flights in boundary layer, liquid-water clouds over the ARM Southern Great Plains (SGP) site between 22 January and 30 June 2009. This was the first time that a long-term aircraft campaign was undertaken for systematic in-situ sampling of cloud properties. Using the CIRPAS Twin Otter aircraft equipped with a comprehensive set of instruments to measure solar and thermal radiation, cloud microphysics, aerosol properties and atmospheric state, the RACORO team logged an unprecedented 59 flights and 259 research hours above the SGP site. Data gathered during the RACORO campaign will provide researchers with a statistically relevant data set of boundary-layer cloud and aerosol properties for future study. These data can be used to validate retrieval algorithms and support process studies and model simulations of boundary layer clouds and, in particular, CLOWD-type clouds. In addition to cloud observations, complementary clear-sky flight patterns were conducted to map the surface albedo, characterize the aerosol and cloud condensation nuclei, and study boundary layer turbulence. For RACORO to operate as a routine, long-term program, flight operations had to be kept as simple as possible to achieve its objectives, which required an operating paradigm different from typical, short-term, intensive aircraft field programs. This poster summarizes RACORO operations, measurements and instruments.

54 ENVIRONMENTAL SCIENCES↗

AN EMPIRICAL UBV RI JHK COLOR-TEMPERATURE CALIBRATION FOR STARS

A collection of Johnson/Cousins photometry for stars with known [Fe/H] is used to generate color-color relations that include the abundance dependence. Literature temperature and bolometric correction (BC) dependences are attached to the color relations. The JHK colors are transformed to the Bessell and Brett homogenized system. The main result of this work is the tabulation of seven colors and the V-band BC as a function of T {sub eff}, log g, and [Fe/H] for -1.06 < V - K < 10.2 and an accompanying interpolation program. Improvements to the present calibration would involve filling photometry gaps, obtaining more accurate and on-system photometry, knowing better log g and [Fe/H] values, improving the statistics for data-impoverished groups of stars such as metal-poor K dwarfs, applying small tweaks in the processing pipeline, and obtaining better empirical temperature and BC relations, especially for supergiants and M stars. A way to estimate dust extinction from M dwarf colors is pointed out.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian Parameter Estimation for Heavy-Duty Vehicles

Accurate vehicle parameters are valuable for design, modeling, and reporting. Estimating vehicle parameters can be a very time-consuming process requiring tightly-controlled experimentation. This work describes a method to estimate vehicle parameters such as mass, coefficient of drag/frontal area, and rolling resistance using data logged during standard vehicle operation. The method uses Monte Carlo to generate parameter sets which is fed to a variant of the road load equation. Modeled road load is then compared to measured load to evaluate the probability of the parameter set. Acceptance of a proposed parameter set is determined using the probability ratio to the current state, so that the chain history will give a distribution of parameter sets. Compared to a single value, a distribution of possible values provides information on the quality of estimates and the range of possible parameter values. The method is demonstrated by estimating dynamometer parameters. Results confirm the method's ability to estimate reasonable parameter sets, and indicates an opportunity to increase the certainty of estimates through careful selection or generation of the test drive cycle.

33 ADVANCED PROPULSION SYSTEMS↗

Guest Molecule Exchange Kinetics for the 2012 Ignik Sikumi Gas Hydrate Field Trial

A commercially viable technology for producing methane from natural gas hydrate reservoirs remains elusive. Short-term depressurization field tests have demonstrated the potential for producing natural gas via dissociation of the clathrate structure, but the long-term performance of the depressurization technology ultimately requires a heat source to sustain the dissociation. A decade of laboratory experiments and theoretical studies have demonstrated the exchange of pure CO2 and N2-CO2 mixtures with CH4 in sI gas hydrates, yielding critical information about molecular mechanisms, recoveries, and exchange kinetics. Findings indicated the potential for producing natural gas with little to no production of water and rapid exchange kinetics, generating sufficient interest in the guest-molecule exchange technology for a field test. In 2012 the U.S. DOE/NETL, ConocoPhillips Company, and Japan Oil, Gas and Metals National Corporation jointly sponsored the first field trial of injecting a mixture of N2-CO2 into a CH4-hydrate bearing formation beneath the permafrost on the Alaska North Slope. Known as the Ignik Sikumi #1 Gas Hydrate Field Trial, this experiment involved three stages: 1) the injection of a N2-CO2 mixture into a targeted hydrate-bearing layer, 2) a 4-day pressurized soaking period, and 3) a sustained depressurization and fluid production period. Data collected during the three stages of the field trial were made available after an extensive quality check. These data included continuous temperature and pressure logs, injected and recovered fluid compositions and volumes. The Ignik Sikumi #1 data set is extensive, but contains no direct evidence of the guest-molecule exchange process. This investigation is directed at using numerical simulation to provide an interpretation of the collected data. A numerical simulator, STOMP-HYDT-KE, was recently completed that solves conservation equations for energy, water, mobile fluid guest molecules, and hydrate guest molecules, for up to three gas hydrate guest molecules: CH4, CO2, and N2. The independent tracking of mobile fluid and hydrate guest molecules allows for the kinetic exchange of guest molecules between the mobile fluids and hydrate. The particular interest of this numerical investigation is to determine whether kinetic exchange parameters, determined from laboratory-scale experiments, are directly applicable to interpreting the Ignik Sikumi #1 data.

Alaska North Slope↗

Testing of the Authenticatable Container Tracking System (ACTS)

The Authenticatable Container Tracking System (ACTS) is being designed to provide a secure container tag that can be used to optimize chain-of-custody monitoring for packaged nuclear materials as they are being stored, processed, and transported. ACTS is an active device that uses an almost-universal core platform that can be appropriately configured to provide the necessary data acquisition, data logging, and communications functions needed for 21st century material accountancy, monitoring, and tracking applications. The core design supports active monitoring of containment, movement, and location and provides secure data transmission via selectable communication methods that can be used throughout the world. This core architecture enables appropriately designed modules to be easily interfaced to the basic system, thus providing an integration path for current and new technologies. ACTS contains a built-in set of sensors but also supports an expansion bus for up to six additional communications, tracking, or sensing modules that may enhance monitoring and tracking of particular containers for specific applications. ACTS stores events in memory, communicates activity to Argonne National Laboratory’s ARG-US TransPort tracking and information server, and provides options for data encryption and authentication. We are currently beginning a testing phase that will field five devices outdoors in a controlled environment to allow evaluation of the functionality of the systems and the hardness of the devices to outdoor conditions. Partners for this system are Oak Ridge National Laboratory, Argonne National Laboratory, Savannah River National Laboratory, Pacific Northwest National Laboratory, and commercialization partner The Aquila Group.

Britton Jr, Chuck↗

SPE2 Far-field Seismic Data Quicklook

The purpose of this report is to provide a brief overview of the far-field seismic data collected by the array of instruments (Figures 1 and 2) deployed by the Source Physics experiment for shots 1 (roughly 100 kg TNT equivalent at a depth of 60 m) and shot 2, (roughly 2000 kg TNT equivalent at a depth of 45 m). 'Far-field' is taken to refer to instruments in the zone of purely elastic response at distances of 100 m or greater. The primary focus is data from the main instrument array and hence data from other groups is not considered. Infrasound data is not addressed nor any remote sensing data. Data processing was done at LLNL in parallel with the effort at UNR. Raw reftek data was sent via hard disk from NsTec. Reftek data was converted to SEGY and then to SAC format. Data files were renamed according to station and channel information. Reftek logs were reviewed. These data have been reviewed for consistency with the UNR data on the server. The primary goal was quality check and a summary is provided in Tables 1 and 2.

58 GEOSCIENCES↗

Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computing Facility (OLCF), however, we unveiled user behavior about the Summit supercomputer by collecting data from a user’s point of view with ordinary Unix commands.In this paper, we discuss the process, challenges, and lessons learned while preparing this dataset for publication and submission to an open data challenge. The original dataset contains personal identifiable information (PII) about the users of OLCF which needed be masked prior to publication, and we determined that anonymization, which scrubs PII completely, destroyed too much of the structure of the data to be interesting for the data challenge. We instead chose to pseudonymize the dataset, which reduced the linkability of the dataset to the users’ identities. Pseudonymization is significantly more computationally expensive than anonymization, and the size of our dataset, which is approximately 175 million lines of raw text, necessitated the development of a parallelized workflow that could be reused on different HPC machines. We demonstrate the scaling behavior of the workflow on two leadership class HPC systems at OLCF, and we show that we were able to bring the overall makespan time from an impractical 20+ hours on a single node down to around 2 hours. As a result of this work, we release the entire pseudonymized dataset and make the workflows and source code publicly available.

Maheshwari, Ketan↗

A Scalable Monitoring for the CMS Filter Farm Based on Elasticsearch

A flexible monitoring system has been designed for the CMS File-based Filter Farm making use of modern data mining and analytics components. All the metadata and monitoring information concerning data flow and execution of the HLT are generated locally in the form of small documents using the JSON encoding. These documents are indexed into a hierarchy of elasticsearch (es) clusters along with process and system log information. Elasticsearch is a search server based on Apache Lucene. It provides a distributed, multitenant-capable search and aggregation engine. Since es is schema-free, any new information can be added seamlessly and the unstructured information can be queried in non-predetermined ways. The leaf es clusters consist of the very same nodes that form the Filter Farm thus providing natural horizontal scaling. A separate central” es cluster is used to collect and index aggregated information. The fine-grained information, all the way to individual processes, remains available in the leaf clusters. The central es cluster provides quasi-real-time high-level monitoring information to any kind of client. Historical data can be retrieved to analyse past problems or correlate them with external information. We discuss the design and performance of this system in the context of the CMS DAQ commissioning for LHC Run 2.

Andre, J. M.↗

Informal Preliminary Report on Comparisons of Prototype SPN-1 Radiometer to PARSL Measurements

The prototype SPN-1 has been taking measurements for several months collocated with our PNNL Atmospheric Remote Sensing Laboratory (PARSL) solar tracker mounted instruments at the Pacific Northwest National Laboratory (PNNL) located in Richland, Washington, USA. The PARSL radiometers used in the following comparisons consist of an Eppley Normal Incident Pyrheliometer (NIP) and a shaded Eppley model 8-48 “Black and White” pyrgeometer (B&W) to measure the direct and diffuse shortwave irradiance (SW), respectively. These instruments were calibrated in mid-September by comparison to an absolute cavity radiometer directly traceable to the world standard group in Davos, Switzerland. The NIP calibration was determined by direct comparison, while the B&W was calibrated using the shade/unshade technique. All PARSL data prior to mid-September have been reprocessed using the new calibration factors. The PARSL data are logged as 1-minute averages from 1-second samples. Data used in this report span the time period from June 22 through December 1, 2006. All data have been processed through the QCRad code (Long and Shi, 2006), which itself is a more elaborately developed methodology along the lines of that applied by the Baseline Surface Radiation Network (BSRN) Archive (Long and Dutton, 2004), for quality control. The SPN-1 data are the standard total and diffuse SW values obtained from the analog data port of the instrument. The comparisons use only times when both the PARSL and SPN-1 data passed all QC testing. The data were further processed and analyzed by application of the SW Flux Analysis methodology (Long and Ackerman, 2000; Long and Gaustad, 2004, Long et al., 2006) to detect periods of clear skies, calculate continuous estimates of clear-sky SW irradiance and the effect of clouds on the downwelling SW, and estimate fractional sky cover.

Long, Charles N.↗

Automated Analysis, Reporting, and Archiving for Robotic Nondestructive Assay of Holdup Deposits - 19508

To decommission deactivated gaseous diffusion enrichment facilities, miles of contaminated pipe must be measured. The current method requires thousands of manual measurements, repeated manual data transcription, and months of manual analysis. The Pipe Crawling Activity Measurement System (PCAMS), developed by Carnegie Mellon University and in commissioning for use at the DOE Portsmouth Gaseous Diffusion Enrichment Facility, uses a robot to measure Uranium-235 from inside pipes and automatically log the data. Radiation measurements, as well as imagery, geometric modeling, and precise measurement positioning data are digitally transferred to the PCAMS server. On the server, data can be automatically processed in minutes and summarized for analyst review. Measurement reports are auto-generated with the push of a button. A database specially-configured to hold heterogeneous data such as spectra, images, and robot trajectories serves as archive. This paper outlines the features and design of the PCAMS Post-Processing Software, currently in commissioning for use at the Portsmouth Gaseous Diffusion Enrichment Facility. The analysis process, the analyst interface to the system, and the content of auto-generated reports are each described. Example pipe-interior geometric surface models, illustration of how key report features apply in operational runs, and user feedback are discussed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

SUPERPOSITION OF POLYTROPES IN THE INNER HELIOSHEATH

This paper presents a possible generalization of the equation of state and Bernoulli's integral when a superposition of polytropic processes applies in space and astrophysical plasmas. The theory of polytropic thermodynamic processes for a fixed polytropic index is extended for a superposition of polytropic indices. In general, the superposition may be described by any distribution of polytropic indices, but emphasis is placed on a Gaussian distribution. The polytropic density–temperature relation has been used in numerous analyses of space plasma data. This linear relation on a log–log scale is now generalized to a concave-downward parabola that is able to describe the observations better. The model of the Gaussian superposition of polytropes is successfully applied in the proton plasma of the inner heliosheath. The estimated mean polytropic index is near zero, indicating the dominance of isobaric thermodynamic processes in the sheath, similar to other previously published analyses. By computing Bernoulli's integral and applying its conservation along the equator of the inner heliosheath, the magnetic field in the inner heliosheath is estimated, B ∼ 2.29 ± 0.16 μG. The constructed normalized histogram of the values of the magnetic field is similar to that derived from a different method that uses the concept of large-scale quantization, bringing incredible insights to this novel theory.

79 ASTRONOMY AND ASTROPHYSICS↗

Moisture Metrics Project

This research added to the understanding of moisture, as it relates to the processing of grass biomass in a commercial setting. It added to the understanding by reinforcing the idea that each grass species has its own unique characteristics as it relates to moisture and processing. And while sometimes these results were not able to be measured according to the parameters of this test project, it was an attribute distinctly noticeable by the end of this project, and discovered by the equipment operators themselves. Key to this discovery was the fact that while a bale of grass may test at a specific moisture percentage with a handheld probe, the actual moisture content within the cell walls of the plant matter may vary significantly from that reading. This difference arises from the ability of some plant species to retain the moisture more within the cell walls, as opposed to other plant species simply holding the moisture on the outer surface of the stalks. This of course is coupled with the methodologies used by the individual landowner in the handling of the biomass, specifically, time of harvest and storage technique. However, it still comes down to different species retaining moisture in different ways according to their cell wall structure. While this may not seem significant, it is of critical importance when you combine that varying trait, with the “action” of processing it. The testing criteria initially established by this project, was in the end inadequate to document these traits thoroughly, and will require future, more detailed projects to adequately document it. The project approach, and the resulting data contained within this report, failed to give us the conclusive data we thought we would eventually arrive at when this project was completed. However, the efforts put forth by this project , and the lack of hard data using our approach, does enable future projects to have a much better understanding of how to approach this subject from a technical standpoint. We have learned that the study must go deeper initially, back to the acreage where the grass was grown, and must include all attributes and inputs beginning there. This data must be logged and correlated along the entire lifecycle of the biomass, from beginning to end, to enable us to fully understand how moisture and specific species of grasses interact when combined with the action of commercial processing.

09 BIOMASS FUELS↗

climextremes v0.2.1

Software package for R and Python for analysis of extremes in climate data. Functions for fitting GEV and POT (via point process fitting) models for extremes in climate data, providing return values, return probabilities, and return periods for stationary and nonstationary models. Also provides differences in return values and differences in log return probabilities for contrasts of covariate values. Functions for estimating risk ratios for event attribution analyses, including uncertainty. Under the hood, many of the functions use functions from 'extRemes', including for fitting the statistical models.

Krishnan, Harinarayan↗

pvOps: a Python package for empirical analysis of photovoltaic field data

The purpose of pvOps is to support empirical evaluations of data collected in the field related to the operations and maintenance (O&M) of photovoltaic (PV) power plants. pvOps presently contains modules that address the diversity of field data, including text-based maintenance logs, current-voltage (IV) curves, and timeseries of production information. The package functions leverage machine learning, visualization, and other techniques to enable cleaning, processing, and fusion of these datasets. These capabilities are intended to facilitate easier evaluation of field patterns and extraction of relevant insights to support reliability-related decision-making for PV sites. The open-source code, examples, and instructions for installing the package through PyPI can be accessed through the GitHub repository.

14 SOLAR ENERGY↗

Archie's Saturation Exponent for Natural Gas Hydrate in Coarse-Grained Reservoirs

Accurately quantifying the amount of naturally occurring gas hydrate in marine and permafrost environments is important for assessing its resource potential and understanding the role of gas hydrate in the global carbon cycle. Electrical resistivity well logs are often used to calculate gas hydrate saturations, S h , using Archie's equation. Archie's equation, in turn, relies on an empirical saturation parameter, n . Though n = 1.9 has been measured for ice–bearing sands and is widely used within the hydrate community, it is highly questionable if this n value is appropriate for hydrate–bearing sands. In this work, we calibrate n for hydrate–bearing sands from the Canadian permafrost gas hydrate research well, Mallik 5L–38, by establishing an independent downhole S h profile based on compressional–wave velocity log data. Using the independently determined S h profile and colocated electrical resistivity and bulk density logs, Archie's saturation equation is solved for n , and uncertainty is tracked throughout the iterative process. In addition to the Mallik 5L–38 well, we also apply this method to two marine, coarse–grained reservoirs from the northern Gulf of Mexico Gas Hydrate Joint Industry Project: Walker Ridge 313–H and Green Canyon 955–H. All locations yield similar results, each suggesting n ≈ 2.5 ± 0.5. Furthermore, for the coarse–grained hydrate bearing ( S h > 0.4) of greatest interest as potential energy resources, we suggest that n = 2.5 ± 0.5 should be applied in Archie's equation for either marine or permafrost gas hydrate settings if independent estimates of n are not available.

58 GEOSCIENCES↗

G-LiHT Campaign Leaf Carbon and Nitrogen Content, Mar2017: Puerto Rico

Measurements of leaf carbon and nitrogen content collected from 68 tropical tree species. Data includes leaves collected from fully sunlit and shaded canopy strata as well as leaves for young, mature, old and senescent leaf ages. Data for each sample includes the relative age estimate, leaf canopy position and sample number. This data was collected as part of the 2017 NGEE-Tropics / NASA G-LiHT airborne campaign. This data package includes processed data for leaf carbon and nitrogen content (*.csv). Metadata files include data description (_dd.csv) for tabular data, site information (*.csv), sampling protocol (*.pdf) and the NGEE-Tropics FRAMES e-field log and file submission metadata (*.xlsx). See related datasets for sample details including photographs, leaf-level reflectance and transmittance spectra, leaf mass per area (LMA) and water content.

54 ENVIRONMENTAL SCIENCES↗

G-LiHT Campaign Leaf Carbon and Nitrogen Content, Mar2017: Puerto Rico

Measurements of leaf carbon and nitrogen content collected from 68 tropical tree species. Data includes leaves collected from fully sunlit and shaded canopy strata as well as leaves for young, mature, old and senescent leaf ages. Data for each sample includes the relative age estimate, leaf canopy position and sample number. This data was collected as part of the 2017 NGEE-Tropics / NASA G-LiHT airborne campaign. This data package includes processed data for leaf carbon and nitrogen content (*.csv). Metadata files include data description (_dd.csv) for tabular data, site information (*.csv), sampling protocol (*.pdf) and the NGEE-Tropics FRAMES e-field log and file submission metadata (*.xlsx). See related datasets for sample details including photographs, leaf-level reflectance and transmittance spectra, leaf mass per area (LMA) and water content.

54 ENVIRONMENTAL SCIENCES↗

New approach of determinations of earthquake moment magnitude using near earthquake source duration and maximum displacement amplitude of high frequency energy radiation

The new approach method to determine the magnitude by using amplitude displacement relationship (A), epicenter distance ({Delta}) and duration of high frequency radiation (t) has been investigated for Tasikmalaya earthquake, on September 2, 2009, and their aftershock. Moment magnitude scale commonly used seismic surface waves with the teleseismic range of the period is greater than 200 seconds or a moment magnitude of the P wave using teleseismic seismogram data and the range of 10-60 seconds. In this research techniques have been developed a new approach to determine the displacement amplitude and duration of high frequency radiation using near earthquake. Determination of the duration of high frequency using half of period of P waves on the seismograms displacement. This is due tothe very complex rupture process in the near earthquake. Seismic data of the P wave mixing with other wave (S wave) before the duration runs out, so it is difficult to separate or determined the final of P-wave. Application of the 68 earthquakes recorded by station of CISI, Garut West Java, the following relationship is obtained: Mw = 0.78 log (A) + 0.83 log {Delta}+ 0.69 log (t) + 6.46 with: A (m), d (km) and t (second). Moment magnitude of this new approach is quite reliable, time processing faster so useful for early warning.

58 GEOSCIENCES↗