SEARCH · Engineering Papers

Results for “Data processing and standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

NASA NTRS2014

Technical Data Interoperability (TDI) Pathfinder Via Emerging Standards

The TDI project (TDI) investigates trending technical data standards for applicability to NASA vehicles, space stations, payloads, facilities, and equipment. TDI tested COTS software compatible with a certain suite of related industry standards for capabilities of individual benefits and interoperability. These standards not only esnable Information Technology (IT) efficiencies, but also address efficient structures and standard content for business processes. We used source data from generic industry samples as well as NASA and European Space Agency (ESA) data from space systems.

Technical Data↗

DOE OSTI2023

Search for long-lived, massive particles in events with displaced vertices and multiple jets in pp collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

A search for long-lived particles decaying into hadrons is presented. The analysis uses 139 fb –1 of $pp$ collision data collected at $\sqrt{s}$ = 13 TeV by the ATLAS detector at the LHC using events that contain multiple energetic jets and a displaced vertex. The search employs dedicated reconstruction techniques that significantly increase the sensitivity to longlived particles decaying in the ATLAS inner detector. Background estimates for Standard Model processes and instrumental effects are extracted from data. The observed event yields are compatible with those expected from background processes. The results are used to set limits at 95% confidence level on model-independent cross sections for processes beyond the Standard Model, and on scenarios with pair-production of supersymmetric particles with long-lived electroweakinos that decay via a small $R$-parity-violating coupling. The pair-production of electroweakinos with masses below 1.5 TeV is excluded for mean proper lifetimes in the range from 0.03 ns to 1 ns. When produced in the decay of $m$($\tilde{g}$) = 2.4 TeV gluinos, electroweakinos with $m$($\tilde{χ}_{1}^{0}$) = 1.5 TeV are excluded with lifetimes in the range of 0.02 ns to 4 ns.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2022

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2023, with start- and end-of-season phenological transition dates derived through the end of autumn 2022. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step Contains 35 files in *.csv format inside a compressed (*.zip) file. Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e. vegetation type) Contains one file in *.csv format Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure Contains two files in *.csv format, one for snow on trees and one for snow on ground This data set consists of two sets of companion files: Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. Contains three files in HTML format, one for each vegetation type One additional file in HTML format with the transition dates plotted for each vegetation type, by year R files for processing Phenocam files and flags. Contains five files in R file (*.R) format in one compressed (*.zip) file User Note: All imagery is posted in near-real time to the PhenoCam Project web page (http://phenocam.sr.unh.edu/), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/y7z5mau7. The data reported here are based on the complete camera record from SPRUCE and supersedes the previously released phenocam datasets (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

SPRUCE Experiment, Marcell Experimental Forest, Sp↗

DOE OSTI2024

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2023

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2024, with start- and end-of-season phenological transition dates derived through the end of autumn 2023. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: (1) 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step • Contains 36 files in *.csv format inside a compressed (*.zip) file. (2) Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e. vegetation type) • Contains one file in *.csv format (3) Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure • Contains two files in *.csv format, one for snow on trees and one for snow on ground This data set consists of two sets of companion files: (1) Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. • Contains three files in HTML format, one for each vegetation type • One additional file in HTML format with the transition dates plotted for each vegetation type, by year (2) R files for processing Phenocam files and flags. • Contains five files in R file (*.R) format in one compressed (*.zip) file User Note: All imagery is posted in near-real time to the PhenoCam Project web page (http://phenocam.sr.unh.edu/), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/sprucecams. The data reported here are based on the complete camera record from SPRUCE and supersedes the previously released data inclusive of the 2015-2022 data (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

Spruce and Peatland Responses Under Changing Envir↗

DOE OSTI2022

Tsdat: An Open-Source Data Standardization Framework for Marine Energy and Beyond: Preprint

Many organizations are tasked with the collection and processing of large quantities of data from various measurement devices. Data reported from these sources are often not interoperable with datasets and software used by analysts and other organizations in the same field, introducing barriers for collaboration on large-scale projects. This poses a particular problem for cross-device comparisons and machine learning applications. To address these challenges, the open source Time-Series Data Pipelines (Tsdat) software was developed by a joint collaboration between Pacific Northwest National Laboratory, the National Renewable Energy Laboratory, and Sandia National Laboratories to facilitate collaboration and accelerate advancements in the Marine Energy domain through the development of an open-source ecosystem of tools. This paper will describe the Tsdat software and the data standards within which the framework operates. A beta version of the framework has been released and is currently being used by several projects in marine energy, wind energy, and building energy systems.

big data↗

DOE OSTI2025

SPRUCE Vegetation Phenology in Experimental Plots from PhenoCam Imagery, 2015-2024

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2025 (2015-08-24 to 2025-03-31), with start- and end-of-season phenological transition dates derived through the end of autumn 2024. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: (1) 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step. • Contains 36 files in *.csv format inside a compressed (*.zip) file. (2) Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e., vegetation type). • Contains one file in *.csv format. (3) Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure. • Contains two files in *.csv format, one for snow on trees and one for snow on ground. This data set consists of two sets of companion files: (1) Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. • Contains three files in HTML format, one for each vegetation type. • One additional file in HTML format with the transition dates plotted for each vegetation type, by year. (2) R files for processing PhenoCam files and flags. • Contains five files in R file(*.R) format and the components of the phenocamr package (Version 1.1.4) used for calculating transition dates for 2015-2024. These are contained in a compressed (*.zip) file. User Note: All imagery is posted in near-real time to the PhenoCam Project web page (https://phenocam.nau.edu), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/sprucecams. This data set is based on the complete camera record from SPRUCE and supersedes all previously released PhenoCam datasets (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2008

Wavenumber Domain Focusing of Squinted SAR Data with a Curved Orbit Geometry

Synthetic Aperture Radar systems provide raw data that need focusing to achieve full-resolution imaging. Current SAR applications, including interferometry, require accurate, phase-preserving, and precisely co-registered coherent images over large ground swaths with the highest achievable resolution. In addition to these challenges, stripmap SAR data may be acquired with an off-broadside (squinted) geometry, either by design or through platform motion. The precise batch focusing of these large aperture and wide bandwidth data sets is known to require a 2D frequency processing approach. The standard wave domain focusing algorithm, however, is only exact for data acquired on a rectilinear trajectory. We investigate a generalization of the standard omega-k focusing formulation that allows curved data acquisition tracks. The new formulation can be used in conjunction with a known extension for conical, squinted imaging grids. The approximations necessary to allow the generalized geometry are analyzed to determine the range of applicability of the proposed algorithm. The theory is validated using data simulated with parameters similar to the UAVSAR L-band SAR system.

curved orbit geometry↗

NASA NTRS1975

LANDSAT US standard catalog, 1-31 December 1975

Information regarding the availability of LANDSAT imagery processed and input to the data files by the NASA Data Processing Facility is published on a monthly basis. The U.S. Standard Catalog includes imagery covering the continental United States, Alaska and Hawaii. The Non-U.S. Standard Catalog identifies all the remaining coverage. Sections 1 and 2 describe the contents and format for the catalogs and the associated microfilm. Section 3 provides a cross-reference defining the beginning and ending dates for LANDSAT cycles. Sections 4 and 5 cover LANDSAT-1 and LANDSAT-2 coverage, respectively.

Source record↗

NASA NTRS1976

LANDSAT: US standard catalog, 1-31 January 1976

Information regarding the availability of LANDSAT imagery processed and input to the data files by the NASA Data Processing Facility is published on a monthly basis. The U.S. Standard Catalog includes imagery covering the continental United States, Alaska and Hawaii. The Non-U.S. Standard Catalog identifies all the remaining coverage. Section 1 and 2 describe the contents and format for the catalogs and the associated microfilm. Section 3 provides a cross-reference defining the beginning and ending dates for LANDSAT cycles. Sections 4 and 5 cover LANDSAT-1 and LANDSAT-2 coverage, respectively.

Source record↗

NASA NTRS1976

LANDSAT: Non-US standard catalog, 1-31 January 1976

Source record↗

NASA NTRS1976

LANDSAT: Non-US standard catalog, 1-29 February 1976

Information regarding the availability of LANDSAT imagery processed and input to the data files by the NASA Data Processing Facility is published on a monthly basis. The U.S. Standard Catalog includes imagery covering the continental United States, Alaska and Hawaii. The non-U.S. Standard Catalog identifies all the remaining coverage. Sections 1 and 2 describe the contents and format for the catalogs and the associated microfilm. Section 3 provides a cross-reference defining the beginning and ending dates for LANDSAT cycles. Sections 4 and 5 cover LANDSAT-1 and LANDSAT-2 coverage, respectively.

Source record↗

NASA NTRS1976

LANDSAT US standard catalog, 1-30 April 1976

Source record↗

NASA NTRS1992

Future Goddard data processing and data distribution systems

This paper discusses the current systems used at the Goddard Space Flight Center for processing spacecraft data, as well as the future system prospects. While current systems rely significantly on minicomputers, future systems will emphasize workstations. Space data formats will become more structured, and the increased application of space data standards will permit greater flexibilities in ground data processing, data distribution and savings in mission and data operations.

Koschmeder, Louis A.↗

DOE OSTI2021

Detecting optical transients using artificial neural networks and reference images from different surveys

ABSTRACT We present a technique to detect optical transients based on an artificial neural networks method. We describe the architecture of two networks capable of comparing images of the same part of the sky taken by different telescopes. One image corresponds to the epoch in which a potential transient could exist; the other is a reference image of an earlier epoch. We use data obtained by the Dr. Cristina V. Torres Memorial Astronomical Observatory and archival reference images from the Sloan Digital Sky Survey. We trained a convolutional neural network and a dense layer network on simulated source samples and then tested the trained networks on samples created from real image data. Autonomous detection methods replace the standard process of detecting transients, which is normally achieved by source extraction of a difference image followed by human inspection of the detected candidates. Replacing the human inspection component with an entirely autonomous method would allow for a rapid and automatic follow-up of interesting targets of opportunity. The toy-model pipeline that we present here is not yet able to replace human inspection, but it might provide useful hints to identify potential candidates. The method will be further expanded and tested on telescopes participating in the Transient Optical Robotic Observatory of the South Collaboration.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1978

LANDSAT 2 world standard catalog, 1 May - 31 July 1978

Source record↗

NASA NTRS1993

International collaboration in SAR ground data systems

A set of considerations that are pertinent to future international cooperation in the area of synthetic aperture radar (SAR) ground data systems are presented. The considerations are as follows: (1) success of future spaceborne SAR missions will require multi-agency and/or multi-national collaboration; (2) ground processing is typically performed by each agency for their user base; (3) international standards are required to achieve a uniform data product independent of the processing center; (4) to reduce the aggregate cost of the ground data systems, collaboration is required in design and development; (5) effective utilization of the data by an international user community; (6) commercialization of data products; and (7) security of data systems.

Curlander, John C.↗

NASA NTRS1989

Linking consistency with object/thread semantics - An approach to robust computation

This paper presents an object/thread based paradigm that links data consistency with object/thread semantics. The paradigm can be used to achieve a wide range of consistency semantics from strict atomic transactions to standard process semantics. The paradigm supports three types of data consistency. Object programmers indicate the type of consistency desired on a per-operation basis and the system performs automatic concurrency control and recovery management to ensure that those consistency requirements are met. This allows programmers to customize consistency and recovery on a per-application basis without having to supply complicated, custom recovery management schemes. The paradigm allows robust and nonrobust computation to operate concurrently on the same data in a well defined manner. The operating system needs to support only one vehicle of computation - the thread.

Chen, Raymond C.↗

DOE OSTI2021

Comparative Assessment of Data-driven Process Models in Health Information Technology

Process mining for conformance analysis consists of comparing a reference process model against a data-driven process model generated via log files from information technology systems. However, in the absence of a complete reference process model, we found no suggested approaches in the literature to address the need for evaluating process conformance among different healthcare facilities to assess standardization of care. Our goal is to find similarities and dissimilarities in data-driven process models among US Veterans Health Administration (VHA) facilities that can be indicative of patient safety issues. Our hypothesis was that the analysis would not produce statistically significant differences in outcome. We present a unique implementation of conformance analysis in process mining that consists of combining process mining, process mapping and statistical metrics. We illustrate our approach by applying it to the analysis of two clinical radiology order process models generated from healthcare data provided by two similar facilities in the VHA. The comparative assessment showed that about 70% of the orders completed successfully and 30% were not completed due to policy and duplications. Our analysis found a good statistical correlation between both facilities, as the Spearman’s correlation coefficient between facilities for the frequency of cases per total hours was 0.87879, for the frequency of cases by state transition was 0.79702 and for the throughput time per state transition was 0.63582. Additional statistical analyses using the Mann-Whitney U test and the root mean square error both produced values that were not significant. The foregoing approach validated our hypothesis by demonstrating a good statistical correlation of data describing the flow of clinical radiology orders absent a credible reference model. Finding good agreement between both facilities was important in confirming that the clinical orders flow in a similar manner, suggesting standardization of care.

97 MATHEMATICS AND COMPUTING↗