SEARCH · Engineering Papers

Results for “data logging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Sample Analysis at Mars Instrument Simulator

The Sample Analysis at Mars Instrument Simulator (SAMSIM) is a numerical model dedicated to plan and validate operations of the Sample Analysis at Mars (SAM) instrument on the surface of Mars. The SAM instrument suite, currently operating on the Mars Science Laboratory (MSL), is an analytical laboratory designed to investigate the chemical and isotopic composition of the atmosphere and volatiles extracted from solid samples. SAMSIM was developed using Matlab and Simulink libraries of MathWorks Inc. to provide MSL mission planners with accurate predictions of the instrument electrical, thermal, mechanical, and fluid responses to scripted commands. This tool is a first example of a multi-purpose, full-scale numerical modeling of a flight instrument with the purpose of supplementing or even eliminating entirely the need for a hardware engineer model during instrument development and operation. SAMSIM simulates the complex interactions that occur between the instrument Command and Data Handling unit (C&DH) and all subsystems during the execution of experiment sequences. A typical SAM experiment takes many hours to complete and involves hundreds of components. During the simulation, the electrical, mechanical, thermal, and gas dynamics states of each hardware component are accurately modeled and propagated within the simulation environment at faster than real time. This allows the simulation, in just a few minutes, of experiment sequences that takes many hours to execute on the real instrument. The SAMSIM model is divided into five distinct but interacting modules: software, mechanical, thermal, gas flow, and electrical modules. The software module simulates the instrument C&DH by executing a customized version of the instrument flight software in a Matlab environment. The inputs and outputs to this synthetic C&DH are mapped to virtual sensors and command lines that mimic in their structure and connectivity the layout of the instrument harnesses. This module executes, and thus validates, complex command scripts prior to their up-linking to the SAM instrument. As an output, this module generates synthetic data and message logs at a rate that is similar to the actual instrument.

Benna, Mehdi↗

NASA NTRS2015

Ultrasonic Stir Welding Development for Ground-Based and In Situ Fabrication and Repair for In-Space Propulsion Systems/Commercial Space Sector

The completed Center Innovation Fund (CIF) project used the upgraded Ultrasonic Stir Weld (USW) Prototype System (built in 2013/2014) to begin characterizing the weld process using 2219 aluminum (fig. 1). This work is being done in Bldg. 4755 at NASA Marshall Space Flight Center (MSFC). The capabilities of the USW system provides the means to precisely control and document individual welding parameters. The current upgraded system has the following capabilities: (1) Ability to 'pulse' ultrasonic (US) energy on and off and adjust parameters real-time (travel speed, spindle rpm, US amplitude, X and Z axis positions, and plunge and pin axis force; (2) Means to measure draw force; (3) Ability to record US power versus time; (4) Increasing stiffness of Z axis drive and reduce head deflection using laser technology; (5) Adding linear encoder to better control tool penetration setting; (6) Ultrasonic energy integrated into stir rod and containment plate; (7) Maximum 600 rpm; (8) Maximum Z force 15,000 lb; (9) Real-time data acquisition and logging capabilities at a minimum frequency of 10 Hz; and (10) Two separate transducer power supplies operating at 4.5 kW power.

Ding, Jeff↗

DOE OSTI2022

Geological characterization and ROZ potential of the Tar Springs Sandstone

This report focuses on regional and field scale geological characterization of the Tar Springs in Illinois using well records, including drilling and completion reports, well logs, and core data (core descriptions/core analyses) to analyze and interpret geological variations. In addition, oil saturation indicators (oil shows, oil saturation from core analysis, and drill stem test data) were analyzed to determine the ROZ potential of the Tar Springs Sandstone

02 PETROLEUM↗

DOE OSTI2020

Hindsight logging for model training

In modern Machine Learning, model training is an iterative, experimental process that can consume enormous computation resources and developer time. To aid in that process, experienced model developers log and visualize program variables during training runs. Exhaustive logging of all variables is infeasible, so developers are left to choose between slowing down training via extensive conservative logging, or letting training run fast via minimalist optimistic logging that may omit key information. As a compromise, optimistic logging can be accompanied by program checkpoints; this allows developers to add log statements post-hoc, and "replay" desired log statements from checkpoint---a process we refer to as hindsight logging. Unfortunately, hindsight logging raises tricky problems in data management and software engineering. Done poorly, hindsight logging can waste resources and generate technical debt embodied in multiple variants of training code. In this paper, we present methodologies for efficient and effective logging practices for model training, with a focus on techniques for hindsight logging. Our goal is for experienced model developers to learn and adopt these practices. To make this easier, we provide an open-source suite of tools for Fast Low-Overhead Recovery (flor) that embodies our design across three tasks: (i) efficient background logging in Python, (ii) adaptive periodic checkpointing, and (iii) an instrumentation library that codifies hindsight logging for efficient and automatic record-replay of model-training. Model developers can use each flor tool separately as they see fit, or they can use flor in hands-free mode, entrusting it to instrument their code end-to-end for efficient record-replay. Our solutions leverage techniques from physiological transaction logs and recovery in database systems. Evaluations on modern ML benchmarks demonstrate that flor can produce fast checkpointing with small user-specifiable overheads (e.g. 7%), and still provide hindsight log replay times orders of magnitude faster than restarting training from scratch.

Computer Science↗

NASA NTRS2014

Evaluating an Automated Approach for Monitoring Forest Disturbances in the Pacific Northwest from Logging, Fire and Insect Outbreaks with Landsat Time Series Data

Forests are the largest aboveground sink for atmospheric carbon (C), and understanding how they change through time is critical to reduce our C-cycle uncertainties. We investigated a strong decline in Normalized Difference Vegetation Index (NDVI) from 1982 to 1991 in Pacific Northwest forests, observed with the National Ocean and Atmospheric Administration's (NOAA) series of Advanced Very High Resolution Radiometers (AVHRRs). To understand the causal factors of this decline, we evaluated an automated classification method developed for Landsat time series stacks (LTSS) to map forest change. This method included: (1) multiple disturbance index thresholds; and (2) a spectral trajectory-based image analysis with multiple confidence thresholds. We produced 48 maps and verified their accuracy with air photos, monitoring trends in burn severity data and insect aerial detection survey data. Area-based accuracy estimates for change in forest cover resulted in producer's and user's accuracies of 0.21 +/- 0.06 to 0.38 +/- 0.05 for insect disturbance, 0.23 +/- 0.07 to 1 +/- 0 for burned area and 0.74 +/- 0.03 to 0.76 +/- 0.03 for logging. We believe that accuracy was low for insect disturbance because air photo reference data were temporally sparse, hence missing some outbreaks, and the annual anniversary time step is not dense enough to track defoliation and progressive stand mortality. Producer's and user's accuracy for burned area was low due to the temporally abrupt nature of fire and harvest with a similar response of spectral indices between the disturbance index and normalized burn ratio. We conclude that the spectral trajectory approach also captures multi-year stress that could be caused by climate, acid deposition, pathogens, partial harvest, thinning, etc. Our study focused on understanding the transferability of previously successful methods to new ecosystems and found that this automated method does not perform with the same accuracy in Pacific Northwest forests. Using a robust accuracy assessment, we demonstrate the difficulty of transferring change attribution methods to other ecosystems, which has implications for the development of automated detection/attribution approaches. Widespread disturbance was found within AVHRR-negative anomalies, but identifying causal factors in LTSS with adequate mapping accuracy for fire and insects proved to be elusive. Our results provide a background framework for future studies to improve methods for the accuracy assessment of automated LTSS classifications.

Landsat↗

NASA NTRS1995

The pulsation index, effective temperature, and thickness of the hydrogen layer in the pulsating DA white dwarf G117-B15A

We have measured the amplitude of the 215 s pulsation of the pulsating DA white dwarf, or ZZ Ceti star, G117-B15A in six passbands with effective wavelengths from 1570 to 6730 A. We find that the index of the pulsation is l = 1 with a high degree of confidence, the first unambiguous determination of l for a pulsation of a ZZ Ceti star. We also find that log g and T(sub eff) are tightly correlated for model atmospheres that fit the data, such that at log g = 7.5 the temperature is 11,750 K and at log g = 8.0 the temperature is 12,375 K. Adopting log g = 7.97 +/- 0.06 from published observations of the optical spectrum of G117-B15A, the correlation yields T(sub eff) = 12,375 +/- 125 K. This temperature is free of flux calibration errors and should be substantially more reliable than temperatures derived for IUE spectra. Since G117-B15A is thought to lie close to the blue edge of the ZZ Ceti instability strip, this low temperature also implies a low temperature for the blue edge. Using pulsation models calculated by Fontaine et al. (1992) and Bradley (1994), we find that the mass of the hydrogen layer in G117-B15A lies between 1.0 x 10(exp -6) solar mass (for k = 1) and 8 x 10(exp -5) solar mass (for k = 2). This range of masses is (barely) consistent with the masses predicted by recent models for the ejection of planetary nebulae, (8-13) x 10(exp -5) solar mass. The mass is too large to be consistent with models invoking thin hydrogen layers to explain the spectral evolution of white dwarfs.

Robinson, E. L.↗

NASA NTRSDate not supplied

Quasi-Wireless Capacitive Power Transfer with Secure Data Acquisition for Robotic Systems in Space Infrastructure

Space exploration is dependent on robotic systems that utilize end-effectors to collect samples, probe surfaces, and manipulate objects. These systems can rarely be designed to do all three, forcing engineers to make tradeoffs based on the mission parameters - i.e. should the robotic appendage have a claw, drill, or shovel, and which would be best suited for the mission? Additionally, as more industrial and government entities partake in space exploration, data protection is needed in transit and at rest. To address these challenges, we present a first-of-its- kind robotic linkage that has no wiring between the joints. Instead, quasi-wireless capacitive (QWiC) power transfer is used to send energy over the robot’s chassis without a return wire. This enables the system to be completely modular through the use of single-contact permanent magnet connections, allowing rapid alterations in joint kinematics and/or the changing of end-effectors. For collecting sensor data from the robotic arm and to send remote commands to it, we use a Supervisory Control and Data Acquisition (SCADA) system. Data transmission relies on MQTT and OPC UA communication protocols with encryption. The SCADA server logs and archives sensor data and provides the functionality for authorized users to send remote commands from SCADA client(s) to motors. A SCADA client can be any of the web browsers that connects to a server via a secure communication channel using SSL protocol. Furthermore, as an extra data protection mechanism, we inject noise to the sensor data traffic, which obfuscates the timing of sensor data packets and adds confusion about which data packet represents which motor.

wireless sensor networks↗

DOE OSTI2022

Automated detection of photovoltaic cleaning events: A performance comparison of techniques as applied to a broad set of labeled photovoltaic data sets

Extracting accurate soiling loss information from photovoltaic (PV) production data first requires segmenting the time series data per natural or manually occurring cleaning events. Maintenance logs are often incomplete, rain data are often unavailable, and the debate on rain thresholds for cleaning and dew or wind cleanings is still ongoing. The present work aims to overtake these issues by improving automated methods to detect these cleaning events and therefore improve extraction of soiling loss information. Time series power production data from 22 PV inverters were labeled for natural or manually occurring cleaning events. The data sets were carefully selected to include varying degrees of soiling, cleaning events, and noise. Several algorithms, including filtering logic and change point detection, were examined for efficacy at detecting the labeled cleanings. All the methods introduced except for changepoint detection showed significant improvement at detecting the labeled cleaning events per the mean F 1 score. Furthermore, the highest performing cleaning detection algorithm achieved an absolute increase in the mean F 1 score of 43% over the default version of the RdTools stochastic rate and recovery (SRR) algorithm. The highest performing algorithm included irradiance filtering and a cleaning detection threshold, adjusted based on the 40-day centered rolling median of the absolute day-to-day deviations in the daily performance index (PI). Furthermore, these improvements are promising as cleaning detection is an essential step in the automated analysis of PV soiling.

14 SOLAR ENERGY↗

DOE OSTI2025

In-Situ Process Monitoring Evaluation and Demonstration using Advanced Characterization with Laser Powder Bed Systems

Oak Ridge National Laboratory’s (ORNL) Manufacturing Demonstration Facility (MDF) worked with EOS Group to evaluate the current in-situ sensor capabilities of an EOS M290 Laser Powder Bed Fusion machine. The M290 was fitted with a 1 Mega-Pixel (MP) grayscale visible-light camera and a 5 MP temporally integrated (TI) near-infrared (NIR) camera. One print from stainless steel (SS) 316 and two from Inconel 625 (IN625) were performed where data including in-situ imaging and a machine log file were captured. These data were subsequently analyzed using a Dynamic Multi-Scale Segmentation Convolutional Neural Network (DMSCNN) trained on user defined classes and correlated to as-printed flaws, in the form of porosity, discovered in X-Ray Computed Tomography (XCT). In Phase I, two indications were detected in-situ and spatially correlated to stochastic lack-of-fusion flaws discovered using XCT. In Phase II, using these links from in-situ signatures to XCT flaw populations, a second neural network (NN) was trained to create a Voxelized Property Prediction Model (VPPM) to predict porosity percentages within the part using only features garnered from the in-situ data from two IN625 complex geometries. The VPPM was able to accurately predict porosity values for IN625 parts with an R 2 value of 0.764.

36 MATERIALS SCIENCE↗

DOE OSTI2025

In-Situ Process Monitoring Evaluation and Demonstration using Advanced Characterization with Laser Powder Bed Systems

36 MATERIALS SCIENCE↗

NASA NTRS1996

Testing of hypotheses about altitude decompression sickness by statistical analyses

This communication extends a statistical analysis of forced-descent decompression sickness at altitude in exercising subjects (J Appl Physiol 1994; 76:2726-2734) with a data subset having an additional explanatory variable, rate of ascent. The original explanatory variables for risk-function analysis were environmental pressure of the altitude, duration of exposure, and duration of pure-O2 breathing before exposure; the best fit was consistent with the idea that instantaneous risk increases linearly as altitude exposure continues. Use of the new explanatory variable improved the fit of the smaller data subset, as indicated by log likelihood. Also, with ascent rate accounted for, replacement of the term for linear accrual of instantaneous risk by a term for rise and then decay made a highly significant improvement upon the original model (log likelihood increased by 37 log units). The authors conclude that a more representative data set and removal of the variability attributable to ascent rate allowed the rise-and-decay mechanism, which is expected from theory and observations, to become manifest.

NASA Center JSC↗

DOE OSTI2025

Monitored Natural Attenuation (MNA) Assessment for the Chemicals, Metals, and Pesticides (CMP) Pits Operable Unit (OU) and the Pen Branch Wetland

In October 2024, Savannah River National Laboratory (SRNL) was tasked to conduct an independent review of groundwater data and assess the monitored natural attenuation (MNA) performance related to the Chemicals, Metals, and Pesticides (CMP) Pits Operable Unit (OU) located in the central portion of the Savannah River Site (SRS). The SRNL assessment of MNA entailed an independent analysis of groundwater concentration data, groundwater elevation data, available surface water concentration data, soil concentration data, and relevant historical geological characterization logs for the CMP Pits OU. Historical data tables and records were obtained from both the Savannah River Nuclear Solutions - Area Completion Projects (SRNSACP) team and South Carolina State University (SCSU) and condensed into new data sets by the SRNL project team for more targeted analysis of MNA performance characteristics. All data pertaining to groundwater concentration, surface water concentration, and groundwater elevation were restricted to collection dates after any known active remediation for the CMP OU.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

LANL HPC Data Center Monitoring: Summer 2023 Talk [Slides]

Data Center Monitoring is the understanding of everything that happens in the Data Center. Our Ultimate (and probably unreachable) Goal is a holistic view of the Data Center and an understanding of how everything is correlated. We get to that Understanding by collecting logs and metrics, analyzing data, displaying information for customers, and staying alert on events.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2000

On Fast Post-Processing of Global Positioning System Simulator Truth Data and Receiver Measurements and Solutions Data

Post-Processing of data related to a Global Positioning System (GPS) simulation is an important activity in qualification of a GPS receiver for space flight. Because a GPS simulator is a critical resource it is desirable to move off the pertinent simulation data from the simulator as soon as a test is completed. The simulator data files are usually moved to a Personal Computer (PC), where the post-processing of the receiver logged measurements and solutions data and simulated data is performed. Typically post-processing is accomplished using PC-based commercial software languages and tools. Because of commercial software systems generality their general-purpose functions are notoriously slow and more than often are the bottleneck problem even for short duration experiments. For example, it may take 8 hours to post-process data from a 6-hour simulation. There is a need to do post-processing faster, especially in order to use the previous test results as feedback for a next simulation setup. This paper demonstrates that a fast software linear interpolation algorithm is applicable to a large class of engineering problems, like GPS simulation data post-processing, where computational time is a critical resource and is one of the most important considerations. An approach is developed that allows to speed-up post-processing by an order of magnitude. It is based on improving the post-processing bottleneck interpolation algorithm using apriori information that is specific to the GPS simulation application. The presented post-processing scheme was used in support of a few successful space flight missions carrying GPS receivers. A future approach to solving the post-processing performance problem using Field Programmable Gate Array (FPGA) technology is described.

Kizhner, Semion↗

NASA NTRS1979

MAIL LOG, program summary and specifications

The summary and specifications to obtain the software package, MAIL LOG, developed for the Scout Project Automatic Data System, SPADS are provided. The MAIL LOG program has four modes of operation: (1) input - putting new records into the data base; (2) revise - changing or modifying existing records in the data base; (3) search - finding special records existing in the data base; and (4) archive - store or put away existing records in the data base. The output includes special printouts of records in the data base and results from the input and search modes.

Harris, D. K.↗

DOE OSTI2020

Data Report: UT-GOM2-1 Lithostratigraphic Core Description Logs at Site GC 955, Holes H002 and H005

Lithostratigraphic core description provides a record of the stratigraphic variation in composition, texture, and sedimentary structure preserved in marine sediment cores. Here we present graphical lithostratigraphic core description logs for pressure cores collected during the 2017 UT GOM2-1 Expedition. The cores summarized here were those that were not retrieved under pressure, but nevertheless recovered some sufficient, intact strata that represent the host lithology across the Green Canyon (GC) 955 gas hydrate reservoir. Our results here represent visual core descriptions and include split core photos and location data for samples collected during core description.

03 NATURAL GAS↗

DOE OSTI2023

Monte Carlo goodness-of-fit tests for degree corrected and related stochastic blockmodels

Abstract We construct Bayesian and frequentist finite-sample goodness-of-fit tests for three different variants of the stochastic blockmodel for network data. Since all of the stochastic blockmodel variants are log-linear in form when block assignments are known, the tests for the latent block model versions combine a block membership estimator with the algebraic statistics machinery for testing goodness-of-fit in log-linear models. We describe Markov bases and marginal polytopes of the variants of the stochastic blockmodel and discuss how both facilitate the development of goodness-of-fit tests and understanding of model behaviour. The general testing methodology developed here extends to any finite mixture of log-linear models on discrete data, and as such is the first application of the algebraic statistics machinery for latent-variable models.

Karwa, Vishesh↗

DOE OSTI2025

SlimIO: Lightweight I/O Path Design for Write Isolation in FDP-backed In-Memory Databases

In-Memory Databases (IMDBs) are widely used with HPC applications to manage transient data, often using snapshot-based persistence for backups. Redis, a representative IMDB, employs both snapshot and Write-Ahead Log (WAL) mechanisms, storing data on persistent devices via the traditional kernel I/O path. This method incurs syscall overhead, I/O contention between processes, and SSD garbage collection (GC) delays. To address these issues, we propose SlimIO, which adopts I/O passthru to minimize syscall overhead and inter-process I/O interference. Additionally, it leverages Flexible Data Placement (FDP) SSDs as backup storage to avoid performance degradation from SSD GC. Experimental results show that SlimIO reduces snapshot time by up to 25%, increases query throughput by up to 30% during non-snapshot periods, and lowers 99.9%-ile latency by up to 50%. Furthermore, it achieves a write amplification factor (WAF) of 1.00, indicating no redundant internal writes, thus extending SSD lifespan.

Lee, Sangyun [Sogang University]↗