Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

LANL Meteorological Program: 2023 Data Completeness/Quality Report

Los Alamos National Laboratory (LANL) operates seven mesa-top instrumented meteorology towers: Technical Area (TA) 6, TA-49, TA-53, TA-54, TA-63, TA-54B, and TA-16B. An additional instrumented tower is located in Mortandad Canyon (TA-5 MDCN), and there is a rain gauge at North Community (NCOM), located within the town of Los Alamos. The 10 meter (m) towers at TA-63, TA-54B, and TA-16B have been in testing since they were installed in 2021, and will be included in a future data completeness report. A description of the meteorology monitoring network, prior to the installation of the TA-63, TA-54B, and TA-16B is found in Dewart and Boggs (2014). Four of the mesa-top towers (e.g., TA-6, TA-49, TA-53, and TA-54) are instrumented at the 1.2 m, 11.5 m, 23 m, and 46 m levels. In addition, the TA-6 tower is instrumented at the 92 m level. The TA-5 MDCN tower is 10 m in height and is instrumented at 1.2 m and 10 m. Data are collected and averaged every 15 minutes. Range checking is performed on each measurement every 15 minutes; data that are beyond normal ranges are eliminated from the data set and replaced by a code for missing data. In addition, data are reviewed weekly by qualified meteorologists to identify bad data not identified by the range checking technique. The data steward eliminates these data from the data set and replaces them with a code for missing data. The instrument technicians also review that data and schedule instrument replacement, as required. All instruments are calibrated at a frequency that meets the criteria identified in ANSI/ANS-3.11-2015. Data completeness is determined by the number of total 15-minute records available versus the number of possible measurements for the entire year. As a rule, the meteorologists do not attempt to estimate data that are eliminated as bad data. Original datalogger records, including bad data, can be recalled from program archival storage.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

NPFTURBULENCE: Turbulent Parameters by airborne measurements

The original data were collected during the field campaign of “Turbulent layers promoting New Particle Formation” experiment (NPFTURBULENCE; https://www.arm.gov/research/campaigns/aaf2024npfturbulence) over the Atmospheric Radiation Measurement (ARM) user facility's Southern Great Plains (SGP) atmospheric observatory (https://www.arm.gov/capabilities/observatories/sgp ) in north-central Oklahoma. The ARM Aerial Facility ArcticShark uncrewed aerial system (UAS, https://www.arm.gov/capabilities/observatories/aaf/uas) was based at Blackwell–Tonkawa Municipal Airport (IATA: BWL, ICAO: KBKN, FAA LID: BKN, 36.74475° N, 97.34918° W, 313.9 m MSL), for the field campaign from May 5 through May 29, 2024. The ArcticShark UAS performed 11 flights, including 10 research flights over the Central Facility of the ARM SGP to measure atmospheric state, turbulence, surface IR temperature and imagery, and aerosol number concentration and size distribution. The current data set presents a comprehensive collection of turbulent parameters in the atmospheric boundary layer or lower free troposphere based on airborne measurement throughout the field campaign. The primary instruments used to create the current data set were the Aircraft Integrated Meteorological Measurement System (AIMMS-30) and the fine-wire thermocouple probe. For user convenience, the current data set includes several parameters commonly used in turbulent research for normalization and/or scaling: atmospheric boundary-layer height, surface conditions, convective scales for temperature, and velocity, etc.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

Lossless compression of image data products on th e FIFE CD-ROM series

How do you store enough of the key data sets, from a total of 120 gigabytes of data collected for a scientific experiment, on a collection of CD-ROM's, small enough to distribute to a broad scientific community? In such an application where information loss in unacceptable, lossless compression algorithms are the only choice. Although lossy compression algorithms can provide an order of magnitude improvement in compression ratios over lossless algorithms the information that is lost is often part of the key scientific precision of the data. Therefore, lossless compression algorithms are and will continue to be extremely important in minimizing archiving storage requirements and distribution of large earth and space (ESS) data sets while preserving the essential scientific precision of the data.

Newcomer, Jeffrey A.↗
NASA NTRS2016

Pattern Recognition Control Design

Spacecraft control algorithms must know the expected spacecraft response to any command to the available control effectors, such as reaction thrusters or torque devices. Spacecraft control system design approaches have traditionally relied on the estimated vehicle mass properties to determine the desired force and moment, as well as knowledge of the effector performance to efficiently control the spacecraft. A pattern recognition approach can be used to investigate the relationship between the control effector commands and the spacecraft responses. Instead of supplying the approximated vehicle properties and the effector performance characteristics, a database of information relating the effector commands and the desired vehicle response can be used for closed-loop control. A Monte Carlo simulation data set of the spacecraft dynamic response to effector commands can be analyzed to establish the influence a command has on the behavior of the spacecraft. A tool developed at NASA Johnson Space Center (Ref. 1) to analyze flight dynamics Monte Carlo data sets through pattern recognition methods can be used to perform this analysis. Once a comprehensive data set relating spacecraft responses with commands is established, it can be used in place of traditional control laws and gains set. This pattern recognition approach can be compared with traditional control algorithms to determine the potential benefits and uses.

Gambone, Elisabeth↗
DOE OSTI2021

Detection of Anomalies in Gamma Background Radiation Data with K-Means and Self-Organizing Map Clustering Algorithms (Consortium on Nuclear Security Technologies (CONNECT) Q1 Report)

Environmental screening of gamma radiation consists of detecting weak nuisance and anomaly signal in the presence of strong and highly varying background. In a typical scenario, a mobile detector-spectrometer continuously measures gamma radiation spectra in short, e.g., one-second, signal acquisition intervals. The measurement data is a 2D matrix, where one dimension is gamma ray energy, and the other dimension is the number of measurements or total time. In principle, gamma radiation sources can be detected and identified from the measured data by their unique spectral lines. Detecting sources from data measured in a search scenario is difficult due to the highly varying background because of naturally occurring radioactive material (NORM), and low signal-to-noise ratio (S/N) of spectral signal measured during one-second acquisition intervals. The objective of this work is to explore unsupervised machine learning (ML) algorithms for detection and identification of weak nuisances and anomalies events in the presence of highly fluctuating background. The challenge is that spectral lines of isotopes are difficult to observe in one-second measurements. Averaging over the entire measurement campaign data set reveals spectral lines of most common background isotopes. Spectral lines of orphan sources, which might appear only in a few measurements during the campaign, will be washed out if averaging is performed over the entire measurement data set. The approach we have explored consists of extracting one-second measurements containing weak spectral features through data clustering. Averaging one-second spectra in a cluster should reveal the presence of anomaly sources. We created two ML models using K-means clustering and Neural Network Self-organizing Map (SOM). Performance of these ML models was benchmarked using search data. One data set contained 137 Cs source, and another dataset contained 131 I source.

61 RADIATION PROTECTION AND DOSIMETRY↗
NASA NTRS1985

Extended testing of a general contextual classifier using the massively parallel processor - Preliminary results and test plans

Earlier encouraging test results of a contextual classifier that combines spatial and spectral information employing a general statistical approach are expanded. The earlier results were of limited meaning because they were produced from small (50-by-50 pixel) data sets. An implementation of the contextual classifier on NASA Goddard's Massively Parallel Processor (MPP) is presented; for the first time the MPP makes feasible the testing of the classifier on large data sets (a 12-hour test on a VAX-11/780 minicomputer now takes 5 minutes on the MPP). The MPP is a Single-Instruction, Multiple Data Stream computer, consisting of 16,384 bit serial microprocessors connected in a 128-by-128 mesh array with each element having data transfer connections with its four nearest neighbors so that the MPP is capable of billions of operations per second. Preliminary results are given (with more expected for the conference) and plans are mentioned for extended testing of the contextual classifier on Thematic Mapper data sets.

Tilton, J. C.↗
NASA NTRS1994

SeaWiFS technical report series. Volume 19: Case studies for SeaWiFS calibration and validation, part 2

This document provides brief reports, or case studies, on a number of investigations and data set development activities sponsored by the Calibration and Validation Team (CVT) within the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Project. Chapter 1 is a comparison with the atmospheric correction of Coastal Zone Color Scanner (CZCS) data using two independent radiative transfer formulations. Chapter 2 is a study on lunar reflectance at the SeaWiFS wavelengths which was useful in establishing the SeaWiFS lunar gain. Chapter 3 reports the results of the first ground-based solar calibration of the SeaWiFS instrument. The experiment was repeated in the fall of 1993 after the instrument was modified to reduce stray light; the results from the second experiment will be provided in the next case studies volume. Chapter 4 is a laboratory experiment using trap detectors which may be useful tools in the calibration round-robin program. Chapter 5 is the original data format evaluation study conducted in 1992 which outlines the technical criteria used in considering three candidate formats, the hierarchical data format (HDF), the common data format (CDF), and the network CDF (netCDF). Chapter 6 summarizes the meteorological data sets accumulated during the first three years of CZCS operation which are being used for initial testing of the operational SeaWiFS algorithms and systems and would be used during a second global processing of the CZCS data set. Chapter 7 describes how near-real time surface meteorological and total ozone data required for the atmospheric correction algorithm will be retrieved and processed. Finally, Chapter 8 is a comparison of surface wind products from various operational meteorological centers and field observations. Surface winds are used in the atmospheric correction scheme to estimate glint and foam radiances.

Hooker, Stanford B.↗
NASA NTRS2020

How Long Is Too Long? Variogram Analysis of AERONET Data to Aid Aerosol Validation and Intercomparison Studies

Geophysical data sets derived from satellite sensors, ground/airborne instrumentation, and computational models are often compared against each other. A common example is the validation of satellite aerosol optical depth (AOD) retrievals against measurements from Aerosol Robotic Network (AERONET) Sun photometers. Spatiotemporal mismatch between data set sampling means that uncaptured variation in the underlying geophysical field introduces apparent disagreement into such comparisons, known as representation or collocation matchup uncertainty. This study uses variogram analysis of AERONET data to estimate temporal mismatch uncertainties and decorrelation time scales for the global AERONET record. As well as total AOD, the fine‐ and coarse‐mode AODs, Ångström Exponent (AE), and fine‐mode fraction (FMF) of AOD are analyzed. Globally, a time difference of 30 min typically induces from 0.011–0.035 variation in AOD. For total, fine, and coarse AODs the typical time to decorrelation is around 2–10 days. For AE and FMF it is 3–33 days; that is, aerosol systems often persist significantly longer than individual events in them. Biomass burning regions tend to show the largest and fastest subdaily AOD variability and also longest times to decorrelation. Some sites show significant season‐to‐season variations in behavior. These results can be used to inform site‐specific time collocation thresholds for aerosol validation analyses and account for temporal variation when estimating data set uncertainty. They also have implications for comparisons between different satellite products or models, data aggregation, and time series analyses. Results are provided on a site‐by‐site basis to facilitate use by other researchers.

satellite↗
NASA NTRS2015

CrIS/ATMS Retrievals Using the Latest AIRS/AMSU Retrieval Methodology

This research is being done under the NPP Science Team Proposal: Analysis of CrISATMS Using an AIRS Version 6-like Retrieval Algorithm Objective: Generate a long term CrISATMS level-3 data set that is consistent with that of AIRSAMSU Approach: Adapt the currently operational AIRS Science Team Version-6 Retrieval Algorithm, or an improved version of it, for use with CrISATMS data. Metric: Generate monthly mean level-3 CrISATMS climate data sets and evaluate the results by comparison of monthly mean AIRSAMSU and CrISATMS products, and more significantly, their inter-annual differences and, eventually, anomaly time series. The goal is consistency between the AIRSAMSU and CrISATMS climate data sets.

Retrieval Methodology↗
NASA NTRS1981

Computer implemented land cover classification using LANDSAT MSS digital data: A cooperative research project between the National Park Service and NASA. 3: Vegetation and other land cover analysis of Shenandoah National Park

Four LANDSAT frames, each corresponding to one of the four seasons were spectrally classified and processed using NASA-developed computer programs. One data set was selected or two or more data sets were marged to improve surface cover classifications. Selected areas representing each spectral class were chosen and transferred to USGS 1:62,500 topographic maps for field use. Ground truth data were gathered to verify the accuracy of the classifications. Acreages were computed for each of the land cover types. The application of elevational data to seasonal LANDSAT frames resulted in the separation of high elevation meadows (both with and without recently emergent perennial vegetation) as well as areas in oak forests which have an evergreen understory as opposed to other areas which do not.

Cibula, W. G.↗
NASA NTRS2001

An Analysis of Simulated and Observed Global Mean Near-Surface Air Temperature Anomalies from 1979 to 1999: Trends and Attribution of Causes

The 1979 - 1999 response of the climate system to variations in solar spectral irradiance is estimated by comparing the global averaged surface temperature anomalies simulated by a 2D (two dimensional) energy balance climate model to observed temperature anomalies. We perform a multiple regression of southern oscillation index and the individual model responses to solar irradiance variations, stratospheric and tropospheric aerosol loading, stratospheric ozone trends, and greenhouse gases onto each of five near-surface temperature anomaly data sets. We estimate the observed difference in global mean near surface air temperature attributable to the solar irradiance difference between solar maximum and solar minimum to be between 0.06 and 0.11 K, and that 1.1 - 3.8% of the total variance in monthly mean near-surface air temperature data is attributable to nations in solar spectral irradiance. For the five temperature data sets used in our analysis, the trends in raw monthly mean temperature anomaly data have a large range, spanning a factor of 3 from 0.06 to 0.17 K/decade. However. our analysis suggests that trends in monthly temperature anomalies attributable to the combination of greenhouse gas, stratospheric ozone, and tropospheric sulfate aerosol variations are much more consistent among data sets, ranging from 0.16 to 0.24 K/decade. Our model results suggest that roughly half of the warming from greenhouse gases is cancelled by the cooling from changes in stratospheric ozone. Tropospheric sulfate aerosol loading in the present day atmospheric contributes significantly to the net radiative forcing of the present day climate system. However, because the change in magnitude and latitudinal distribution of tropospheric sulfate aerosol has been small over the past 20 years, the change in the direct radiative forcing attributable to changes in aerosol loading over this time is also small.

MacKay, R. M.↗
NASA NTRS1997

Frozen-Flux Modelling for Epochs 1915 and 1980

The frozen-flux hypothesis for the Earth's liquid core assumes that convective terms dominate diffusive terms in the induction equation governing the behaviour of the magnetic field at the surface of the core. While highly plausible on the basis of estimates of physical parameters, the hypothesis has been questioned. To study this hypothesis, we improve the method which tests the consistency of magnetic observations with the hypothesis by constructing simple, flux-conserving core-field models fitting the data at pairs of epochs. We introduce a new approach that fixes the patch configurations at each of the two epochs before inversion, so that each configuration is consistent with its respective data set but possesses the same patch topology. We expand upon the inversion algorithm, using quadratic programming to maintain the proper flux sign within patches; the modelling calculations are also extended to include data types that depend non-linearly on the model. Every test of a hypothesis depends on the characterization of the observational uncertainties; we undertake a thorough review of this question. For main-field models, the primary source of uncertainty comes from the crustal field. We base our analysis on statistical models of the crustal magnetization, adjusted to bring it into better conformity with our data set. The noise model permits us to take into account the correlations between the measurements and requires that a different weighting be given to horizontal and vertical components. It also indicates that the observations should be fit more closely than has been the practice heretofore. We apply the revised method to Magsat data from 1980 and survey and observatory data from 1915.5, two data sets believed to be particularly difficult to reconcile with the frozen-flux hypothesis. We compute a pair of simple, flux-conserving models that fit the averaged data from each epoch. We therefore conclude that present knowledge of the geomagnetic fields of 1980 and 1915.5 is consistent with the frozen-flux hypothesis.

OBrien, Michael S.↗
NASA NTRS1984

The pilot climate data system

The Pilot Climate Data System (PCDS) is an interactive scientific information management system for locating, obtaining, manipulating, and displaying climate-research data. The PCDS was developed to manage a large collection of data of interest to the National Aeronautics and Space Administration's (NASA) research community and currently provides such support for approximately twenty data sets. In order to provide the PCDS capabilities, NASA's Goddard Space Flight Center (NASA/GSFC) has integrated the capabilities of several general-purpose software packages with specialized software for reading and reformatting the supported data sets. These capabilities were integrated in a manner which allows the PCDS to be easily expanded, either to provide support for additional data sets or to provide additional functional capabilities. This also allows the PCDS to take advantage of new technology as it becomes available, since parts of the system can be replaced with more powerful components without significantly affecting the user interface.

Reph, M. G.↗
NASA NTRS2012

Generating Ground Reference Data for a Global Impervious Surface Survey

We are engaged in a project to produce a 30m impervious cover data set of the entire Earth for the years 2000 and 2010 based on the Landsat Global Land Survey (GLS) data set. The GLS data from Landsat provide an unprecedented opportunity to map global urbanization at this resolution for the first time, with unprecedented detail and accuracy. Moreover, the spatial resolution of Landsat is absolutely essential to accurately resolve urban targets such as buildings, roads and parking lots. Finally, with GLS data available for the 1975, 1990, 2000, and 2005 time periods, and soon for the 2010 period, the land cover/use changes due to urbanization can now be quantified at this spatial scale as well. Our approach works across spatial scales using very high spatial resolution commercial satellite data to both produce and evaluate continental scale products at the 30m spatial resolution of Landsat data. We are developing continental scale training data at 1m or so resolution and aggregating these to 30m for training a regression tree algorithm. Because the quality of the input training data are critical, we have developed an interactive software tool, called HSegLearn, to facilitate the photo-interpretation of high resolution imagery data, such as Quickbird or Ikonos data, into an impervious versus non-impervious map. Previous work has shown that photo-interpretation of high resolution data at 1 meter resolution will generate an accurate 30m resolution ground reference when coarsened to that resolution. Since this process can be very time consuming when using standard clustering classification algorithms, we are looking at image segmentation as a potential avenue to not only improve the training process but also provide a semi-automated approach for generating the ground reference data. HSegLearn takes as its input a hierarchical set of image segmentations produced by the HSeg image segmentation program [1, 2]. HSegLearn lets an analyst specify pixel locations as being either positive or negative examples, and displays a classification of the study area based on these examples. For our study, the positive examples are examples of impervious surfaces and negative examples are examples of non-impervious surfaces. HSegLearn searches the hierarchical segmentation from HSeg for the coarsest level of segmentation at which selected positive example locations do not conflict with negative example locations and labels the image accordingly. The negative example regions are always defined at the finest level of segmentation detail. The resulting classification map can be then further edited at a region object level using the previously developed HSegViewer tool [3]. After providing an overview of the HSeg image segmentation program, we provide a detailed description of the HSegLearn software tool. We then give examples of using HSegLearn to generate ground reference data and conclude with comments on the effectiveness of the HSegLearn tool.

Tilton, James C.↗
DOE OSTI2024

SPRUCE 13C-Phospholipid Fatty Acid (13C-PLFA) Abundances, June 2014-June 2015

This data set provides the results of 13C phospholipid fatty acid analysis (13C-PLFA) of peat samples collected from ambient and experimental plots in the SPRUCE experiment site. The samples used to generate this data set were collected just prior to initiation of deep peat heating (DPH; 03 June 2014), after 3 months (09 September 2014), and after 10 months (16 June 2015). This data set includes the abundances and delta-13C isotopic signatures of individual lipids and of groups of lipids indicating total biomass, fungi, Gram-positive bacteria, Gram-negative bacteria, actinomycetes, and anaerobic bacteria. This dataset contains two files in comma separate (*.csv) format. Cores extending to 250 cm (200 cm in June 2015) were collected and subsampled at 10 cm intervals from 0 and 100 cm and 25 cm intervals below 100 cm depth. During the lipid extraction procedure, samples were pooled into the following depth increments in order to obtain sufficient material to achieve adequate lipid yield: 0-20, 20-50, 50-100, 100-150, 150-200, and 200-250cm.

actinomycetes↗
DOE OSTI2020

PPINN: Parareal physics-informed neural network for time-dependent PDEs

Physics-informed neural networks (PINNs) encode physical conservation laws and prior physical knowledge into the neural networks, ensuring the correct physics is represented accurately while alleviating the need for supervised learning to a great degree. While effective for relatively short-term time integration, when long time integration of the time-dependent PDEs is sought, the time–space domain may become arbitrarily large and hence training of the neural network may become prohibitively expensive. To this end, we develop a parareal physics-informed neural network (PPINN), hence decomposing a long-time problem into many independent short-time problems supervised by an inexpensive/fast coarse-grained (CG) solver. In particular, the serial CG solver is designed to provide approximate predictions of the solution at discrete times, while initiate many fine PINNs simultaneously to correct the solution iteratively. There is a two-fold benefit from training PINNs with small-data sets rather than working on a large-data set directly, i.e., training of individual PINNs with small-data is much faster, while training the fine PINNs can be readily parallelized. Consequently, compared to the original PINN approach, the proposed PPINN approach may achieve a significant speed-up for long-time integration of PDEs, assuming that the CG solver is fast and can provide reasonable predictions of the solution, hence aiding the PPINN solution to converge in just a few iterations. To investigate the PPINN performance on solving time-dependent PDEs, we first apply the PPINN to solve the Burgers equation, and subsequently we apply the PPINN to solve a two-dimensional nonlinear diffusion–reaction equation. Furthermore, our results demonstrate that PPINNs converge in a few iterations with significant speed-ups proportional to the number of time-subdomains employed.

42 ENGINEERING↗
NASA NTRS1999

Modeling Surface Structure Derived from Laser Altimeter Return Waveforms Using High-Resolution Elevation Data

The upcoming generation of operational spaceborne laser altimeters (i.e VCL and GLAS) record the interaction of emitted laser radiation with terrestrial surfaces in the form of a digitized waveform. We show that we can accurately model return laser altimeter waveforms as the sum of the reflections from individual surfaces within laser footprints. In one case, we predict return waveforms using high resolution elevation data generated by a small-footprint laser altimeter in a dense tropical forest. We compare over 3000 modeled and recorded waveform pairs using the Pearson correlation. The modeled and recorded waveforms are highly correlated, with a mean correlation of 0.90 and a median of 0.95. The mean correlation is highly dependent on the relative positions of the data sets. By shifting the relative locations of the two compared data sets, we infer that the data are colocated to within 0.4$\sim$m horizontally and 0.12$\sim$m vertically. The high degree of correlation shows that we can reliably synthesize the vertical structure information measured by medium-large footprint laser altimeters for complex, dense vegetation.

Blair, J. Bryan↗
DOE OSTI2024

Predicting Anaerobic Membrane Bioreactor Performance Using Flow-Cytometry-Derived High and Low Nucleic Acid Content Cells

Having a tool to monitor the microbial abundances rapidly and to utilize the data to predict the reactor performance would facilitate the operation of an anaerobic membrane bioreactor (AnMBR). This study aims to achieve the aforementioned scenario by developing a linear regression model that incorporates a time-lagging mode. The model uses low nucleic acid (LNA) cell numbers and the ratio of high nucleic acid (HNA) to LNA cells as an input data set. First, the model was trained using data sets obtained from a 35 L pilot-scale AnMBR. The model was able to predict the chemical oxygen demand (COD) removal efficiency and methane production 3.5 days in advance. Subsequent validation of the model using flow cytometry (FCM)-derived data (at time t – 3.5 days) obtained from another biologically independent reactor did not exhibit any substantial difference between predicted and actual measurements of reactor performance at time t. Further cell sorting, 16S rRNA gene sequencing, and correlation analysis partly attributed this accurate prediction to HNA genera (e.g., Anaerovibrio and unclassified Bacteroidales) and LNA genera (e.g., Achromobacter, Ochrobactrum, and unclassified Anaerolineae). In summary, our findings suggest that HNA and LNA cell routine enumeration, along with the trained model, can derive a fast approach to predict the AnMBR performance.

42 ENGINEERING↗