Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data versions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,711 records · Page 95

Triaxial Probe Magnetic Data Analysis

The Triaxial Magnetic Moment Analysis software uses measured magnetic field test data to compute dipole and quadrupole moment information from a hardware element. It is used to support JPL projects needing magnetic control and an understanding of the spacecraft-generated magnetic fields. Evaluation of the magnetic moment of an object consists of three steps: acquisition, conditioning, and analysis. This version of existing software was extensively rewritten for easier data acquisition, data analysis, and report presentation, including immediate feedback to the test operator during data acquisition. While prior JPL computer codes provided the same data content, this program has a better graphic display including original data overlaid with reconstructed results to show goodness of fit accuracy and better appearance of the report graphic page. Data are acquired using three magnetometers and two rotations of the device under test. A clean acquisition user interface presents required numeric data and graphic summaries, and the analysis module yields the best fit (least squares) for the magnetic dipole and/or quadrupole moment of a device. The acquisition module allows the user to record multiple data sets, selecting the best data to analyze, and is repeated three times for each of the z-axial and y-axial rotations. In this update, the y-axial rotation starting position has been changed to an option, allowing either the x- or z-axis to point towards the magnetometer. The code has been rewritten to use three simultaneous axes of magnetic data (three probes), now using two "rotations" of the device under test rather than the previous three rotations, thus reducing handling activities on the device under test. The present version of the software gathers data in one-degree increments, which permits much better accuracy of the fit ted data than the coarser data acquisition of the prior software. The data-conditioning module provides a clean data set for the analysis module. For multiple measurements at a given degree, the first measurement is used. For omitted measurements, the missing field is estimated by linear interpolation between the two nearest measurements. The analysis module was rewritten for the dual rotation, triaxial probe measurement process and now has better moment estimation accuracy, based on the finer one degree of data acquisition resolution. The magnetic moments thus computed are used as an input to summarize the total spacecraft field.

Shultz, Kimberly↗

High-resolution (30-m) urban land cover projections for Los Angeles California Urban Area: 2010 to 2100 under SSP3 and SSP5 [Updated simulations based on population-driven urban intensity transitions]

These data (v3) are updated from previous versions (1 and 2) in that they include consider the effects of population on transitions in urban land intensity. This leads to more reasonable differences in urban land projections under variant SSPs. For the present dataset, both SSP3 and SSP5 are provided. These data represent simulations of future land use and land cover (LULCC) for Los Angeles urban area (U.S. Census Bureau defined area) as raster tiff images at a 30-m pixel resolution and at decadal time steps from 2010 to 2100. LULCC classes in this product follow the National Land Cover Dataset (NLCD) classification. NLCD 21-24 correspond to open developed, low developed, medium developed, and high developed urban land classes, respectively. Only urban land cover classes (NLCD class 21, 22, 23, and 24) are dynamic over time; however, all NLCD classes are included in the final product. Therefore, NLCD classes that do not convert to an urban class will be similar to year 2000. The products were developed using a hybridized statistical and cellular automata approach. Linear mixed models (LMMs) were used to estimate future urban land budgets based on 1-km urban land fraction projections from Gao and Pesaresi (2021), whereas separate generalized linear mixed models (GLMMs) were used to estimate shifts in urban land intensities based on retrospective shifts in NLCD urban class intensities over a 20- year period. Based on urban land allocations from the statistical models, a cellular-automata and downscaling routine was used to simulate dynamic urban land expansion at a 30-m resolution based on suitability criteria. Scenarios of future urban landcover change projections include variant solutions for the Shared Socioeconomic Pathway 5 (SSP5) and SSP 3 based on different population assumptions, different land use intensification assumptions, variable land zoning constraints, and iterative adjustments to correct for over allocation of urban expansion across decadal time periods from 2010 to 2100. This results in 320 raster products.

Land↗

Tsdat: An Open-Source Data Standardization Framework for Marine Energy and Beyond

Many organizations are tasked with the collection and processing of large quantities of data from various measurement devices. Data reported from these sources are often not interoperable with datasets and software used by analysts and other organizations in the same domain, introducing barriers for collaboration on large-scale projects. This poses a particular problem for cross-device comparisons and machine learning applications, which rely on large quantities of data from multiple sources. To address these challenges, the open-source Time-Series Data Pipelines (Tsdat) Python framework was developed by Pacific Northwest National Laboratory, with strategic guidance and direction provided by the National Renewable Energy Laboratory and Sandia National Laboratories to facilitate collaboration and accelerate advancements in the marine energy domain through the development of an open-source ecosystem of tools. This paper will describe the Tsdat framework and the data standards within which it operates. A beta version of Tsdat has been released and is being used by several projects in marine energy, wind energy, and building energy systems.

big data↗

Evaluating 239 Pu(n,f) cross sections via machine learning using experimental data, covariances, and measurement features

In this paper, the neutron-induced 239 Pu fission cross section, 239 Pu(n,f), is evaluated from 1–20 MeV using experimental data and associated covariances while also considering information on the measurement, termed features here. For instance, methods to determine the background, sample backing material, or impurities in the sample, are explicitly taken into account in the evaluation process. To this end, outliers in the experimental data are identified with a modified version of the Hybrid Robust Support Vector Machine. In a second step, two machine learning methods (logistic regression with elastic net regularization and random forest regression with SHAP feature importance metric) are used to highlight measurement features that are common among many of the outlying data points. Based on this analysis, penalty uncertainties are added to the experimental covariances of outlying data points that have outlier measurement features and are put through the generalized-least-squares evaluation. The resulting evaluated mean values and covariances differ distinctly from those data evaluated without the penalty uncertainties. These results highlight that certain measurement features should be more closely examined.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Extending "Deep Blue" Aerosol Retrieval Coverage to Cases of Absorbing Aerosols Above Clouds: Sensitivity Analysis and First Case Studies

Cases of absorbing aerosols above clouds (AACs), such as smoke or mineral dust, are omitted from most routinely processed space-based aerosol optical depth (AOD) data products, including those from the Moderate Resolution Imaging Spectroradiometer (MODIS). This study presents a sensitivity analysis and preliminary algorithm to retrieve above-cloud AOD and liquid cloud optical depth (COD) for AAC cases from MODIS or similar sensors, for incorporation into a future version of the "Deep Blue" AOD data product. Detailed retrieval simulations suggest that these sensors should be able to determine AAC AOD with a typical level of uncertainty approximately 25-50 percent (with lower uncertainties for more strongly absorbing aerosol types) and COD with an uncertainty approximately10-20 percent, if an appropriate aerosol optical model is known beforehand. Errors are larger, particularly if the aerosols are only weakly absorbing, if the aerosol optical properties are not known, and the appropriate model to use must also be retrieved. Actual retrieval errors are also compared to uncertainty envelopes obtained through the optimal estimation (OE) technique; OE-based uncertainties are found to be generally reasonable for COD but larger than actual retrieval errors for AOD, due in part to difficulties in quantifying the degree of spectral correlation of forward model error. The algorithm is also applied to two MODIS scenes (one smoke and one dust) for which near-coincident NASA Ames Airborne Tracking Sun photometer (AATS) data were available to use as a ground truth AOD data source, and found to be in good agreement, demonstrating the validity of the technique with real observations.

aerosols above clouds↗

Technical Report Series on Global Modeling and Data Assimilation: The Climate of the FVCCM-3 Model - Volume 20

This document describes the climate of version 1 of the NASA-NCAR model developed at the Data Assimilation Office (DAO). The model consists of a new finite-volume dynamical core and an implementation of the NCAR climate community model (CCM-3) physical parameterizations. The version of the model examined here was integrated at a resolution of 2 degrees latitude by 2.5 degrees longitude and 32 levels. The results are based on assimilation that was forced with observed sea surface temperature and sea ice for the period 1979-1995, and are compared with NCEP/NCAR reanalyses and various other observational data sets. The results include an assessment of seasonal means, subseasonal transients including the Madden Julian Oscillation, and interannual variability. The quantities include zonal and meridional winds, temperature, specific humidity, geopotential height, stream function, velocity potential, precipitation, sea level pressure, and cloud radiative forcing.

Suarez, Max J.↗

The Impact of TRMM Data on Numerical Forecast of Mesoscale Systems

The impact of surface rainfall data derived from the TRMM Microwave Image (TMI) on the numerical forecast of mesoscale systems is evaluated. A series of numerical experiments are performed that assimilate TMI rainfall data into the Penn State University/National Centers for Atmospheric Research (PSU/NCAR) Mesoscale Model version 5 (MM5) using a four-dimensional variational data assimilation (4DVAR) technique. Experiments are conducted incorporating TMI rainfall data into the mesoscale model to improve hurricane initialization. It is found that assimilation of rainfall data into the model is beneficial in producing a more realistic eye and rain bands and also helps to improve the intensity forecast for the hurricane. Further 4DVAR experiments are performed on mesoscale convective systems (MCSs). Detailed results and related issues will be presented during the conference.

Pu, Zhao-Xia↗

A comprehensive guide to CAN IDS data and introduction of the ROAD dataset

Although ubiquitous in modern vehicles, Controller Area Networks (CANs) lack basic security properties and are easily exploitable. A rapidly growing field of CAN security research has emerged that seeks to detect intrusions or anomalies on CANs. Producing vehicular CAN data with a variety of intrusions is a difficult task for most researchers as it requires expensive assets and deep expertise. To illuminate this task, we introduce the first comprehensive guide to the existing open CAN intrusion detection system (IDS) datasets. We categorize attacks on CANs including fabrication (adding frames, e.g., flooding or targeting and ID), suspension (removing an ID’s frames), and masquerade attacks (spoofed frames sent in lieu of suspended ones). We provide a quality analysis of each dataset; an enumeration of each datasets’ attacks, benefits, and drawbacks; categorization as real vs. simulated CAN data and real vs. simulated attacks; whether the data is raw CAN data or signal-translated; number of vehicles/CANs; quantity in terms of time; and finally a suggested use case of each dataset. State-of-the-art public CAN IDS datasets are limited to real fabrication (simple message injection) attacks and simulated attacks often in synthetic data, lacking fidelity. In general, the physical effects of attacks on the vehicle are not verified in the available datasets. Only one dataset provides signal-translated data but is missing a corresponding “raw” binary version. This issue pigeon-holes CAN IDS research into testing on limited and often inappropriate data (usually with attacks that are too easily detectable to truly test the method). The scarcity of appropriate data has stymied comparability and reproducibility of results for researchers. As our primary contribution, we present the Real ORNL Automotive Dynamometer (ROAD) CAN IDS dataset, consisting of over 3.5 hours of one vehicle’s CAN data. ROAD contains ambient data recorded during a diverse set of activities, and attacks of increasing stealth with multiple variants and instances of real (i.e. non-simulated) fuzzing, fabrication, unique advanced attacks, and simulated masquerade attacks. To facilitate a benchmark for CAN IDS methods that require signal-translated inputs, we also provide the signal time series format for many of the CAN captures. Our contributions aim to facilitate appropriate benchmarking and needed comparability in the CAN IDS research field.

97 MATHEMATICS AND COMPUTING↗

The preparation of high quality machine-readable classical catalogs for incorporation into astronomical databases

The merging of data from various catalogs and their incorporation into existing databases such as SIMBAD is a demanding task, mainly because of the diverse and inconsistent astronomical nomenclature that has developed over the years. Although the cross identification of objects by computer is in principle an extremely simple procedure, numerous pitfalls have been encountered in practice because of errors and mutually exclusive identifications in existing catalogs. The incorporation of classical and new data into SIMBAD is clearly simplified if machine versions of catalogs are prepared with a view toward this problem. New versions of a number of important catalogs have been prepared and fully documented at the Astronomical Data Center, NASA Goddard Space Flight Center with consideration of both independent use and data integration. Recently completed catalogs and current projects will be reviewed in this presentation.

Warren, Wayne H., Jr.↗

Progress Towards AIRS Science Team Version-7 at SRT

The AIRS Science Team Version-6 retrieval algorithm is currently producing level-3 Climate Data Records (CDRs) from AIRS that have been proven useful to scientists in understanding climate processes. CDRs are gridded level-3 products which include all cases passing AIRS Climate QC. SRT has made significant further improvements to AIRS Version-6. At the last Science Team Meeting, we described results using SRT AIRS Version-6.22. SRT Version-6.22 is now an official build at JPL called 6.2.4. Version-6.22 results are significantly improved compared to Version-6, especially with regard to water vapor and ozone profiles. We have adapted AIRS Version-6.22 to run with CrIS/ATMS, at the Sounder SIPS which processed CrIS/ATMS data for August 2014. JPL AIRS Version-6.22 uses the Version-6 AIRS tuning coefficients. AIRS Version-6.22 has at least two limitations which must be improved before finalization of Version-7: Version-6.22 total O3 has spurious high values in the presence of Saharan dust over the ocean; and Version-6.22 retrieved upper stratospheric temperatures are very poor in polar winter. SRT Version-6.28 addresses the first concern. John Blaisdell ran the analog of AIRS Version-6.28 in his own sandbox at JPL for the 14th and 15th of every month in 2014 and all of July and October for 2014. AIRS Version-6.28a is hot off the presses and addresses the second concern.

CrIS↗

The DAO Retrospective Data Assimilation System

The fixed-lag Kalman smoother of Cohn et al. (1994), or a version of a more computationally feasible approximation of it developed by Todling et al. (1998), is under implementation at the Data Assimilation Office (DAO) to build a retrospective data assimilation system (RDAS). The initial version of the RDAS uses the physical-space statistical analysis system and a modification of the incremental analysis update (IAU) procedure of Bloom et al. (1996); a follow up version of the RDAS Nill require the use of the adjoint of the DAO general circulation model (developed by Y. Yang and M Navon). The retrospective procedure is designed to produce improved analyses as well as improved assimilated fields consequently providing an improved climate representation through data assimilation.

Todling, Richardo↗

Documentation for the machine-readable version of A Catalogue of Extragalactic Radio Source Identifications (Veron-Cetty and Veron 1983)

Detailed descriptions of the data and reference files of the updated and final version of the machine-readable catalog are given. The computerized catalog has greatly expanded since the original published version (1974), and additional information is given. A separate reference file contains bibliographical citations ordered simultaneously by numerical reference and alphabetically by author.

Warren, W. H., Jr.↗

PlantCV v4: Image analysis software for high‐throughput plant phenotyping

PlantCV is an open-source Python project aimed at developing tools to address a range of image-based, plant phenotyping questions. PlantCV has been used for more than 10 years to automate trait collection from image data, and the newest release, PlantCV version 4, continues to lower the barrier to entry for users without substantial coding experience through extensive example use-case tutorials and simplified installation. In addition to usability, we document added functionality since the release of PlantCV v2, including support for more image types such as fluorescence, thermal, and hyperspectral data. Finally, we describe the development of a new subpackage focused on morphological trait measurements like leaf angle, and demonstrate its utility as compared to more manual methods of data collection.

Schuhl, Haley [Donald Danforth Plant Science Cente↗

Surface and Atmospheric Shortwave Radiative Fluxes From ISCCP Data and Fu-Liou Algorithm at Higher Spatial and Vertical Resolution

NASA/GEWEX Surface Radiation Budget (SRB) has provided surface and TOA shortwave and longwave radiative fluxes using International Satellite Cloud Climatology data as the primary input. Release 4.0 came out in 2019, with data from July 1983 through June 2017, and improved validation stats relative to Release 3.0 (Stackhouse et al., 2012). Release 4.0 used the newly reprocessed ISCCP H data set. The shortwave algorithm for versions 3 and 4 has been based on the Pinker and Laszlo (1992) algorithm, which relies on the satellite-measured shortwave radiance to produce a TOA albedo. This background TOA albedo is made utilizing the background clear-sky visible radiance (called clear-sky composite radiance in the ISCCP data) and applying narrowband-to-broadband angular distribution models. Using a climatological aerosol assumption, the surface albedo is estimated using radiative transfer based (i.e., Fu/Liou radiative transfer model; Fu and Liou, 1993) look-up tables. Using this surface albedo and an instantaneous TOA albedo, the look-up tables are used to adjust both the aerosol optical depth (for clear sky) and cloud optical depth (for cloudy sky) for each scene. These properties and look up tables are then used to generate surface fluxes. While this has worked well to provide useful fluxes, it has occasionally resulted in inaccurate direct and diffuse surface SW fluxes due to the overreliance on aerosol optical depth. With increased computational power and storage now available, a more direct approach is now possible. Here we present a different approach for a future high resolution SRB Release 5.0. We replace the Pinker-Laszlo lookup table approach with a forward call to the Fu-Liou radiative transfer model as modified by the CERES team (Rose et al., 2006). In addition to being a proven radiation code, Fu-Liou allows the calculation of fluxes at different atmospheric levels and spectral bands, which will provide more insight into the surface radiation budget, its variability and attribution. It is expected that horizontal resolution will increase to at least 0.5°x0.5° from the current 1°x1°. Here we demonstrate a preliminary look at the next SRB, and show comparisons with the current release.

Earth Radiation Budget↗

Robust Online Sequential RVFLNs for Data Modeling of Dynamic Time-Varying Systems with Application of an Ironmaking Blast Furnace

In a world where the increasing complexity of modern industrial processes brings difficulties for accurate mathematical modeling, taking advantage of data has become an efficient solution to complex dynamic process modeling issue. In this paper, we develop a novel robust online sequential version of random vector functional-link networks (RVFLNs) for data-driven modeling of dynamic time-varying system and applied it in a blast furnace (BF) ironmaking process. First, to overcome the time-varying dynamics of process and to enable the RVFLNs to learn online with avoiding data saturation, an improved online sequential version of RVFLNs (OS-RFVLNs) is first presented by online sequential learning with forgetting factor. This improved OS-RVFLNs algorithm is not only suitable for the real-time and large data transfer situation, but also can adjust the sensitivity of the algorithm to different samples with the help of the introduced forgetting factor. Second, since the output weights of the improved OS-RVFLNs as well as other RVFLNs algorithms are obtained by the least squares approach, a robustness problem may occur when the training dataset is contaminated with various outliers. To solve this problem, a Cauchy distribution weighted M-estimator is introduced to improve the robustness of the improved OS- RVFLNs. For this proposed robust OS-RVFLNs (R-OS- RVFLNs), since the weights of different outlier data are properly determined by the Cauchy distribution function, their corresponding contribution on modeling can be properly distinguished. Thus robust and better modeling results can be achieved. Experiments using actual industrial data of BF ironmaking process and comparative studies have demonstrated that the proposed method produces a better estimation accuracy and stronger robustness than other methods.

Blast furnace (BF), Modelling, Dynamic systems↗

ESS-DIVE reporting format for leaf-level gas exchange data and metadata

Here we present documentation of the ESS-DIVE reporting format for leaf-level gas exchange data and metadata. This reporting format provides guidance to data contributors on how to store data to maximize their discoverability, facilitate their efficient reuse, and add value to individual datasets. For data users, the reporting format will better allow data repositories to optimize data search and extraction, and more readily integrate similar data into harmonized synthesis products. The reporting format specifies data table variable naming and unit conventions, as well as metadata characterizing experimental conditions and protocols. For common data types that were the focus of this initial version of the reporting format, i.e., survey measurements, dark respiration, carbon dioxide and light response curves, and parameters derived from those measurements, we took a further step of defining required additional data that would maximize the potential reuse of those data types. To aid data contributors and the development of data ingest tools by data repositories we provided a translation table comparing the outputs of common gas exchange instruments. The reporting format presented here is intended to form a foundation for future development that will incorporate additional data types and variables as gas exchange systems and measurement approaches advance in the future. The reporting format documentation is maintained and updated on the ESS-DIVE Community Space GitHub. This data package is the first published version of this reporting format, and comprises a zip file of the complete content of https://github.com/ess-dive-community/essdive-leaf-gas-exchange v1.0. The zip contains the reporting format description, guidelines, variable tables and instructions in GitHub markdown language (*.md) and 2 metadata templates as spreadsheets with drop down options (*.xlsx files, also function in GoogleSheets).

54 ENVIRONMENTAL SCIENCES↗

A senstitivity study of the ground hydrologic model using data generated by an atmospheric general circulation model

The Ground Hydrologic Model (GHM) developed for use in an atmospheric general circulation model (GCM) has been refined. A series of sensitivity studies of the new version of the GHM were conducted for the purpose of understanding the role played by various physical parameters in the GHM. The following refinements have been made: (1) the GHM is coupled directly with the planetary boundary layer (PBL); (2) a bulk vegetation layer is added with a more realistic large-scale parameterization; and (3) the infiltration rate is modified. This version GHM has been tested using input data derived from a GCM simulation run for eight North America regions for 45 days. The results are compared with those of the resident GHM in the GCM. The daily average of grid surface temperatures from both models agree reasonably well in phase and magnitude. However, large difference exists in one or two regions on some days. The daily average evapotranspiration is in general 10 to 30% less than the corresponding value given by the resident GHM.

Sun, S. F.↗

New Collections of Aura Atmospheric data Products at the GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the primary archive of atmospheric composition data from the Aura Ozone Monitoring Instrument (OMI), Microwave Limb sounder (MLS), and High-Resolution Dynamics Limb Sounder (HIRDLS) instruments. The most recent versions of Aura OMI, MLS and HIRDLS data are available free to the public (http://disc.gsfc.nasa.gov/Aura). TES data are at ASDC (http://eosweb.larc.nasa.gov).

Johnson, James↗