Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing and logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

Enhancing DSN Operations Efficiency with the Discrepancy Reporting Management System (DRMS)

The DRMS is the Discrepancy Reporting Management System used by the Deep Space Network (DSN). It uses a web interface and is a management tool designed to track and manage: data outage incidents during spacecraft tracks against equipment and software known as DRs (discrepancy Reports), to record "out of pass" incident logs against equipment and software in a Station Log, to record instances where equipment has be restarted or reset as Reset records, and to electronically record equipment readiness status across the DSN. Tracking and managing these items increases DSN operational efficiency by providing: the ability to establish the operational history of equipment items, data on the quality of service provided to the DSN customers, the ability to measure service performance, early insight into processes, procedures and interfaces that may need updating or changing, and the capability to trace a data outage to a software or hardware change. The items listed above help the DSN to focus resources on areas of most need.

Discrepancy Reporting Management Systems (DRMS)↗
DOE OSTI2022

MARSAME Radiological Release Report for Metal Items from TA 53, Set 20

EPC-ES has evaluated the survey results for metal items from the Los Alamos Neutron Science Center (LANSCE) and found that the metal items described in Table 1 of this report (identified by RP Tracking Numbers) meet the criteria for unrestricted release under DOE Order 458.1 Radiation Protection of the Public and the Environment (DOE 2020) and can be recycled. This conclusion is based on the known history of the metal items and on radiation survey data (see the completed RP-Form-031 LANSCE Metals Clearance Log for each item). None of the items in this report are located within radiological areas. Therefore, the items are considered unencumbered and are not subject to the moratorium suspension on metal recycling from Department of Energy facilities. Additionally, LANL has determined that there is no practical opportunity for internal DOE reuse or recycling of this metal. Process knowledge indicates that these metal items were unlikely to ever be in direct contact with the beam and thus are unlikely to have become activated. Surface contamination measurements (both total and removable) showed either no detectable radioactivity or activity levels within the range of background. All measurements for volumetric contamination were indistinguishable from background based on calculated decision limits. Additionally, all gamma isotopic surveys conducted for defense-in-depth showed no identifiable gamma radiation from beam activation.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1974

Image reproduction with interactive graphics

Software application or development in optical image digital data processing requires a fast, good quality, yet inexpensive hard copy of processed images. To achieve this, a Cambo camera with an f 2.8/150-mm Xenotar lens in a Copal shutter having a Graflok back for 4 x 5 Polaroid type 57 pack-film has been interfaced to an existing Adage, AGT-30/Electro-Mechanical Research, EMR 6050 graphic computer system. Time-lapse photography in conjunction with a log to linear voltage transformation has resulted in an interactive system capable of producing a hard copy in 54 sec. The interactive aspect of the system lies in a Tektronix 4002 graphic computer terminal and its associated hard copy unit.

Buckner, J. D.↗
NASA NTRS2012

Key Decision Record Creation and Approval Module

Retaining good key decision records is critical to ensuring the success of a project or operation. Having adequately documented decisions with supporting documents and rationale can greatly reduce the amount of rework or reinvention over a project's, vehicle's, or facility's lifecycle. Stennis Space Center developed and uses a software tool that automates the Key Decision Record (KDR) process for its engineering and test projects. It provides the ability for a user to log key decisions that are made during the course of a project. By customizing Parametric Technology Corporation's (PTC) Windchill product, the team was able to log all information about a decision, and electronically route that information for approval. Customizing the Windchill product allowed the team to directly connect these decisions to the engineering data that it might affect and notify data owners of the decision. The user interface was created in JSP and Javascript, within the OOTB (Out of the Box) Windchill product, allowing users to create KDRs. Not only does this interface allow users to create and track KDRs, but it also plugs directly into the OOTB ability to associate these decision records with other relevant engineering data such as drawings, designs, models, requirements, or specifications

Hebert, Barrt↗
DOE OSTI2022

Predicting Search Task Difficulty through a Discrete‐Time Action Log Representation on Spectrum Kernel

ABSTRACT Predicting perceived difficulty on a web search task is an open problem in the interactive information retrieval field. A common approach to tackle it, is through features obtained from full search sessions, which are then used to train classification models. In this poster we attempt to predict perceived task difficulty at different stages of the search process. To do so, we use the spectrum kernel for support vector machine (SVM) classification. Our preliminary results suggest that by using behavioral data from the first query segment, it is possible to provide timely classifications of whether a search task is perceived as hard or easy.

Gacitúa, Daniel↗
DOE OSTI2021

SECARB-USA: Needs Assessment Framework for Storage Complexes (Task 2.1.b)

A team of SECARB storage experts examined 63 formations at 39 sites that were selected to represent the range of diversity of newly assessed, as well as well-advanced, storage prospects in the SECARB region. We inventoried the data needs triggered by the requirements to obtain a Class VI UIC storage permit, the data needs that results from the requirement to create geocellular fluid flow models to support that permit, and by pragmatic and best practice inputs such as public acceptance, regulatory readiness, and pore space leasing. We anchored both the needs inventory and the processes for and cost of meeting the needs with data from 9 sites in in the SECARB area that have advanced far in characterization. Results show that the total cost of characterization prior to obtaining a permit is convergent, because the permit and modeling requirements drive projects to obtain the same types of data for all cases. The high cost data that control cost are 1) drilling, coring, core-testing, logging, sampling and testing a characterization well and 2) collection of a 3-D seismic survey to map reservoir and confining system properties over the area of the plume or the area of elevated pressure. In 5 of our case study sites we determined that one or both of these costs could be avoided because the needs are met by available data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Expandable Log Analyzing Framework

Prior to my internship, I was informed that a previous intern had built a tool to analyse MongoDB logs and look for invalid access attempts, which served as a great reference point for my project. I was initially tasked with expanding on her prototype and filling in the gaps such as integrating it with the main monitoring tool the lab uses. Eventually, the scope grew, expanding to support other databases and a growing collection of tools. I organized the framework around an observer pattern, meaning one point in the program sending updates to the rest of the framework. Every time a log was read and parsed, it was sent to be processed by the tools, using the type of event as a means to determine which tools should get a chance to act on the log. This decouples the tools from the log reader, making future updates and additions much easier. The framework processes MongoDB logs at ~135,000 entries per second and PostgreSQL logs at ~170,500 entries per second, accurately detecting anomalies such as slow queries and connections from unknown addresses. This framework serves to fill gaps in database monitoring tools currently implemented at the lab, such as tracking failed authentication for PostgreSQL and MongoDB which had very minimal or none before this framework. National labs such as Fermilab hold sensitive data and valuable computing resources, making them attractive targets. Monitoring intrusion attempts on databases is made much easier by this comprehensive monitoring suite.

Clark, Dylan [Unlisted, IL]↗
DOE OSTI2026

Expandable Log Analyzing Framework

Prior to my internship, I was informed that a previous intern had built a tool to analyse MongoDB logs and look for invalid access attempts, which served as a great reference point for my project. I was initially tasked with expanding on her prototype and filling in the gaps such as integrating it with the main monitoring tool the lab uses. Eventually, the scope grew, expanding to support other databases and a growing collection of tools. I organized the framework around an observer pattern, meaning one point in the program sending updates to the rest of the framework. Every time a log was read and parsed, it was sent to be processed by the tools, using the type of event as a means to determine which tools should get a chance to act on the log. This decouples the tools from the log reader, making future updates and additions much easier. The framework processes MongoDB logs at ~135,000 entries per second and PostgreSQL logs at ~170,500 entries per second, accurately detecting anomalies such as slow queries and connections from unknown addresses. This framework serves to fill gaps in database monitoring tools currently implemented at the lab, such as tracking failed authentication for PostgreSQL and MongoDB which had very minimal or none before this framework. National labs such as Fermilab hold sensitive data and valuable computing resources, making them attractive targets. Monitoring intrusion attempts on databases is made much easier by this comprehensive monitoring suite.

Clark, Dylan [Unlisted, IL]↗
DOE OSTI2023

Application of Electromagnetic Methods for Reservoir Monitoring with Emphasis on Carbon Capture, Utilization, and Storage

The Controlled-Source ElectroMagnetic (CSEM) method provides crucial information about reservoir fluids and their spatial distribution. Carbon dioxide (CO2) storage, enhanced oil recovery (EOR), geothermal exploration, and lithium exploration are ideal applications for the CSEM method. The versatility of CSEM permits its customization to specific reservoir objectives by selecting the appropriate components of a multi-component system. To effectively tailor the CSEM approach, it is essential to determine whether the primary target reservoir is resistive or conductive. This task is relatively straightforward in CO2 monitoring, where the injected fluid is resistive. However, for scenarios involving brine-saturated (water-wet) or oil-wet (carbon capture, utilization, and storage—CCUS) reservoirs, consideration must also be given to conductive reservoir components. The optimization of data acquisition before the survey involves analyzing target parameters and the sensitivity of multi-component CSEM. This optimization process typically includes on-site noise measurements and 3D anisotropic modeling. Based on our experience, subsequent surveys tend to proceed smoothly, yielding robust measurements that align with scientific objectives. Other critical aspects to be considered are using magnetotelluric (MT) measurements to define the overall background resistivities and integrating real-time quality assurance during data acquisition with 3D modeling. This integration allows the fine tuning of acquisition parameters such as acquisition time and necessary repeats. As a result, data can be examined in real-time to assess subsurface information content while the acquisition is ongoing. Consequently, high-quality data sets are usually obtained for subsequent processing and initial interpretation with minimal user intervention. The implementation of sensitivity analysis during the inversion process plays a pivotal role in ensuring that the acquired data accurately respond to the target reservoirs’ expected depth range. To elucidate these concepts, we present an illustrative example from a CO2 storage site in North Dakota, USA, wherein the long-offset transient electromagnetic method (LOTEM), a variation of the CSEM method, and the MT method were utilized. This example showcases how surface measurements attain appropriately upscaled log-scale sensitivity. Furthermore, the sensitivity of the CSEM and MT methods was examined in other case histories, where the target reservoirs exhibited conductive properties, such as those encountered in enhanced oil recovery (EOR), geothermal, and lithium exploration applications. The same equipment specifications were utilized for CSEM and MT surveys across all case studies.

Barajas-Olalde, César↗
DOE OSTI2026

Database-Agnostic Log Analysis and Monitoring Framework

Prior to my internship, I was informed that a previous intern had built a tool to analyse MongoDB logs and look for invalid access attempts, which served as a great reference point for my project. I was initially tasked with expanding on her prototype and filling in the gaps such as integrating it with the main monitoring tool the lab uses. Eventually, the scope grew, expanding to support other databases and a growing collection of tools. I organized the framework around an observer pattern, meaning one point in the program sending updates to the rest of the framework. Every time a log was read and parsed, it was sent to be processed by the tools, using the type of event as a means to determine which tools should get a chance to act on the log. This decouples the tools from the log reader, making future updates and additions much easier. The framework processes MongoDB logs at ~135,000 entries per second and PostgreSQL logs at ~170,500 entries per second, accurately detecting anomalies such as slow queries and connections from unknown addresses. This framework serves to fill gaps in database monitoring tools currently implemented at the lab, such as tracking failed authentication for PostgreSQL and MongoDB which had very minimal or none before this framework. National labs such as Fermilab hold sensitive data and valuable computing resources, making them attractive targets. Monitoring intrusion attempts on databases is made much easier by this comprehensive monitoring suite.

Clark, Dylan [Unlisted, US, IL; Fermilab]↗
NASA NTRS1992

The EXOSAT database and archive

The EXOSAT database provides on-line access to the results and data products (spectra, images, and lightcurves) from the EXOSAT mission as well as access to data and logs from a number of other missions (such as EINSTEIN, COS-B, ROSAT, and IRAS). In addition, a number of familiar optical, infrared, and x ray catalogs, including the Hubble Space Telescope (HST) guide star catalog are available. The complete database is located at the EXOSAT observatory at ESTEC in the Netherlands and is accessible remotely via a captive account. The database management system was specifically developed to efficiently access the database and to allow the user to perform statistical studies on large samples of astronomical objects as well as to retrieve scientific and bibliographic information on single sources. The system was designed to be mission independent and includes timing, image processing, and spectral analysis packages as well as software to allow the easy transfer of analysis results and products to the user's own institute. The archive at ESTEC comprises a subset of the EXOSAT observations, stored on magnetic tape. Observations of particular interest were copied in compressed format to an optical jukebox, allowing users to retrieve and analyze selected raw data entirely from their terminals. Such analysis may be necessary if the user's needs are not accommodated by the products contained in the database (in terms of time resolution, spectral range, and the finesse of the background subtraction, for instance). Long-term archiving of the full final observation data is taking place at ESRIN in Italy as part of the ESIS program, again using optical media, and ESRIN have now assumed responsibility for distributing the data to the community. Tests showed that raw observational data (typically several tens of megabytes for a single target) can be transferred via the existing networks in reasonable time.

Reynolds, A. P.↗
DOE OSTI2022

MARSAME Radiological Release Report for Metal Items from TA 53, Set 22

EPC-ES has evaluated the survey results for metal items from the Los Alamos Neutron Science Center (LANSCE) and found that the metal items described in Table 1 of this report (identified by RP Tracking Numbers) meet the criteria for unrestricted release under DOE Order458.1 Radiation Protection of the Public and the Environment (DOE 2020) and can be recycled. This conclusion is based on the known history of the metal items and on radiation survey data (see the completed RP-Form-031 LANSCE Metals Clearance Log [LANL 2021a] for each item). None of the items in this report are located within radiological areas. Therefore, the items are considered unencumbered and are not subject to the moratorium suspension on metal recycling from Department of Energy facilities. Additionally, LANL has determined that there is no practical opportunity for internal DOE reuse or recycling of this metal. Process knowledge indicates that these metal items were unlikely to ever bein direct contact with the beam and thus are unlikely to have become activated. Surface contamination measurements (both total and removable) showed either no detectable radioactivity or activity levels within the range of background. All measurements for volumetric contamination were indistinguishable from background based on calculated decision limits. Additionally, all gamma isotopic surveys conducted for defense-in-depth showed no identifiable gamma radiation from beam activation.

36 MATERIALS SCIENCE↗
NASA NTRS1995

Hypergolic oxidizer and fuel scrubber emissions

Hypergolic fuels and oxidizer are emitted to the environment during fueling and deservicing shuttle and other spacecraft. Such emissions are difficult to measure due to the intermittent purge flow and to the presence of suspended scrubber liquor. A new method for emissions monitoring was introduced in a previous paper. This paper is a summary of the results of a one-year study of shuttle launch pads and orbiter processing facilities (OPF's) which proved that emissions can be determined from field scrubbers without direct measurement of vent flow rate and hypergol concentration. This new approach is based on the scrubber efficiency, which was measured during normal operations, and on the accumulated weight of hypergol captured in the scrubber liquor, which is part of the routine monitoring data of scrubber liquors. To validate this concept, three qualification tests were performed, logs were prepared for each of 16 hypergol scrubbers at KSC, the efficiencies of KSC scrubbers were measured during normal operations, and an estimate of the annual emissions was made based on the efficiencies and the propellant buildup data. The results have confirmed that the emissions from the KSC scrubbers can be monitored by measuring the buildup of hypergol propellant in the liquor, and then using the appropriate efficiency to calculate the emissions. There was good agreement between the calculated emissions based on outlet concentration and flow rate, and the emissions calculated from the propellant buildup and efficiency. The efficiencies of 12 KSC scrubbers, measured under actual servicing operations and special test conditions, were assumed to be valid for all subsequent operations until a significant change in hardware occurred. An estimate of the total emissions from 16 scrubbers for three years showed that 0.3 kg/yr of fuel and 234 kg/yr of oxidizer were emitted.

Parrish, Clyde F.↗
NASA NTRS1986

Preliminary geological investigation of AIS data at Mary Kathleen, Queensland, Australia

The Airborne Imaging Spectrometer (AIS) was flown over granitic, volcanic, and calc-silicate terrain around the Mary Kathleen Uranium Mine in Queensland, in a test of its mineralocial mapping capabilities. An analysis strategy and restoration and enhancement techniques were developed to process the 128 band AIS data. A preliminary analysis of one of three AIS flight lines shows that the data contains considerable spectral variation but that it is also contaminated by second-order leakage of radiation from the near-infrared region. This makes the recognition of expected spectral absorption shapes very difficult. The effect appears worst in terrains containing considerable vegetation. Techniques that try to predict this supplementary radiation coupled with the log residual analytical technique show that expected mineral absorption spectra can be derived. The techniques suggest that with additional refinement correction procedures, the Australian AIS data may be revised. Application of the log residual analysis method has proved very successful on the cuprite, Nevada data set, and for highlighting the alunite, linite, and SiOH mineralogy.

Huntington, J. F.↗
NASA NTRS2012

Requirements-Driven Log Analysis Extended Abstract

Imagine that you are tasked to help a project improve their testing effort. In a realistic scenario it will quickly become clear, that having an impact is diffcult. First of all, it will likely be a challenge to suggest an alternative approach which is significantly more automated and/or more effective than current practice. The reality is that an average software system has a complex input/output behavior. An automated testing approach will have to auto-generate test cases, each being a pair (i; o) consisting of a test input i and an oracle o. The test input i has to be somewhat meaningful, and the oracle o can be very complicated to compute. Second, even in case where some testing technology has been developed that might improve current practice, it is then likely difficult to completely change the current behavior of the testing team unless the technique is obviously superior and does everything already done by existing technology. So is there an easier way to incorporate formal methods-based approaches than the full edged test revolution? Fortunately the answer is affirmative. A relatively simple approach is to benefit from possibly already existing logging infrastructure, which after all is part of most systems put in production. A log is a sequence of events, generated by special log recording statements, most often manually inserted in the code by the programmers. An event can be considered as a data record: a mapping from field names to values. We can analyze such a log using formal methods, for example checking it against a formal specification. This separates running the system for analyzing its behavior. It is not meant as an alternative to testing since it does not address the important in- put generation problem. However, it offers a solution which testing teams might accept since it has low impact on the existing process. A single person might be assigned to perform such log analysis, compared to the entire testing team changing behavior.

log analysis↗
DOE OSTI2023

Arctic Mixed-Phase Cloud Base Ice Precipitation Properties Over the NSA Site

Cloud-climate feedbacks are still the greatest source of uncertainty in current climate projections. Arctic clouds, which are predominantly stratiform and supercooled, often long-lived, and nearly continuously precipitate ice particles, contribute roughly 10% of the uncertainty attributed to the global cloud feedback. This arctic cloud uncertainty is driven by incomplete observational and theoretical knowledge required to estimate and explain the state and active processes occurring in those clouds. A focus on ice precipitation properties at arctic cloud base rather than the surface deconfounds the product of cloud condensate sink processes from the influence of the atmospheric thermodynamic state below cloud base, rendering cloud-base properties a more appealing target for inference and evaluation of model simulations. This data set provides more than 1800 samples of cloud-base ice precipitation properties over Utqiagvik, North Slope of Alaska, all of which were retrieved using the synthesis of ARM radar and lidar measurements. The retrieved ice precipitation variables in this data set include, among others, the ice number concentration, water content, PSD parameters, precipitation rate, mass-weighted fall velocity, vertical air motion, and effective radius, all of which are highly valuable for model evaluation and a general understanding of polar cloud sink processes. Each variable sample includes its mean value and associated uncertainty. Additional variables based on ARM measurements (liquid layer statistics, etc.) are included in this data set. The retrieval algorithm and analysis of this data set are described in Silber (JGR, 2023, https://doi.org/10.1029/2022JD038202).

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1974

Effects of turbulence in the atmosphere of Venus on Pioneer Venus radio, phase 2

Two problems related to the effects of turbulence in the atmosphere of Venus on the Pioneer entry probe radio link were studied. In the first problem, the cross correlation between the log amplitude and phase fluctuations of the Pioneer Venus communications link is examined. Data show that for fluctuation frequencies above approximately 1 Hz there is little or no correlation. For frequencies below this region the correlation is weak and the square root of the coherence has a peak value close to 0.65. The second problem consists of interferring turbulence characteristics of the Venus atmosphere from the Mariner 5 phase fluctuations. Data show that with the data processing techniques developed and currently available, the phase error due to oscillator drift, assumed trajectory delay, and spline curve fit exceed the turbulence induced fluctuations. Results show that it is not possible to interfere with the turbulence characteristics from Mariner 5 phase fluctuations.

Woo, R. T.↗
DOE OSTI2024

Vegetation Warming Experiment: Plant Physiology, Utqiagvik (Barrow), Alaska, 2021

Leaf gas exchange measurements on Carex aquatilis Wahlenb. following a single season warming treatment. Data were collected in 2021 from 5 treatment warming chambers and paired control plots located on the Barrow Environmental Observatory (BEO), Utqiagvik, Alaska. Data include CO2 response (ACi) curves, light response (AQ) curves, and dark-adapted respiration (Rdark) logged data measured at controlled leaf temperatures from 5–25 °C. The data package includes 4 data files in .csv format, 10 metadata files and the complete instrument output for all measurements. These data were collected as part of an experiment using Zero Power Warming (ZPW) chambers that delivered a single season warming treatment of ~4 °C above ambient air temperature. Four different plant species were targeted over four experimental years from 2017–2021. See related data packages for processed gas exchange data, leaf trait data (leaf mass per area, leaf nitrogen concentration), ambient and chamber environmental conditions, phenocamera images, thaw depth and GPS locations of chambers. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗