Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data product”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Processed Data Reformatted

This dataset contains plant-level wind power production data from ERCOT, recorded at 15-minute intervals. The source of this data is ERCOT's 60-Day SCED Disclosure Report (product number NP3-965-ER), with timestamps provided in UTC.

17 WIND ENERGY↗

Validation of SCIAMACHY Radiances and Ozone Products Using Ground and Space Observations

Validation of SCIAMACHY data products are is key element for the detecting a stratospheric ozone recovery, which is a high priority for environmental research and environmental policy. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify its recovery. We show that validation of satellite radiances from space and from the ground can be an effective means for correcting long term drifts of backscatter type satellite measurements such as SCIAMACHY and can be used to cross calibrate all BUV instruments in orbit (TOMS, SBUV/2, GOME, OMI, GOME-2, OMPS). This method bypasses the retrieval algorithms used for both satellite and ground based measurements that are normally used to validate and correct the satellite data. This approach however requires well calibrated instruments and an accurate radiative transfer model that accounts for aerosols. In addition to comparing radiances, validation of SCIAMACHY ozone products will conducted by comparing total and profile ozone with TOMS and SBUV/2.

Hilsenrath, E.↗

Aligning NASA Earth Science Data Stewardship with FAIR Principles: Outcomes, Recommendations, and Future Directions

The FAIR Principles—Findable, Accessible, Interoperable, and Reusable—offer a widely accepted framework for improving the sharing and reuse of digital scientific data by both human and machine users. Following these principles is critical for effective scientific data stewardship, broader scientific collaboration, and compliance with federal and agency data policies. This paper, based on the work of NASA’s Open, Free, and FAIR Working Group (O’FAIR WG) under the Earth Science Data Systems Program, presents an overview of how FAIR is being applied within NASA’s Earth science data landscape. It highlights ongoing progress and challenges, identifies FAIR-enabling resources, and offers recommendations and strategic actions to enhance the FAIRness of NASA-funded open and free Earth science data products. The FAIR-enabling resources identified underscore the vital role of NASA's existing enterprise processes, standards, tools, and infrastructures in supporting FAIR implementation. Our findings show strong performance in making NASA Earth science data more findable and accessible. However, further work is needed—especially in enhancing interoperability, so that different systems and tools can better understand and exchange data. This is especially important for enabling machine-driven discovery and analysis. We emphasize the importance of a balanced strategy that combines a centralized, top-down approach—focused on building enterprise-level capabilities and processes—with a decentralized, bottom-up approach driven by discipline-specific needs and community practices. We advocate for coordinated efforts to enhance (meta)data interoperability to facilitate seamless data and information sharing and exchange of Earth science data both within NASA and across other agencies managing Earth science data.

Data Product↗

How many offshore wind turbines does New England need?

The proliferation of countries and regions with 100% clean or renewable energy targets necessitates an analysis to determine the number of generating units and storage needed to meet real-time electricity demand on the electric grid. The coastal areas of New England have the capacity to produce a large percentage of the region's energy needs with offshore wind turbines. Here we model offshore wind turbine power production data using MERRA-2 reanalysis and lidar wind speed data sets. We compare this power production to the New England hourly grid demand over the course of one year. 2,000 10 MW offshore wind turbines could satisfy New England's grid demand for about 37% of the year. When combined with 55 GWh of storage, 2,000 turbines could satisfy grid demand for about 72% of the year.

17 WIND ENERGY↗

A framework for collaborative review of candidate events in high data rate streams: The V-FASTR experiment as a case study

“Fast radio transients” are defined here as bright millisecond pulses of radio-frequency energy. These short-duration pulses can be produced by known objects such as pulsars or potentially by more exotic objects such as evaporating black holes. The identification and verification of such an event would be of great scientific value. This is one major goal of the Very Long Baseline Array (VLBA) Fast Transient Experiment (V-FASTR), a software-based detection system installed at the VLBA. V-FASTR uses a “commensal” (piggy-back) approach, analyzing all array data continually during routine VLBA observations and identifying candidate fast transient events. Raw data can be stored from a buffer memory, which enables a comprehensive off-line analysis. This is invaluable for validating the astrophysical origin of any detection. Candidates discovered by the automatic system must be reviewed each day by analysts to identify any promising signals that warrant a more in-depth investigation. To support the timely analysis of fast transient detection candidates by V-FASTR scientists, we have developed a metadata-driven, collaborative candidate review framework. The framework consists of a software pipeline for metadata processing composed of both open source software components and project-specific code written expressly to extract and catalog metadata from the incoming V-FASTR data products, and a web-based data portal that facilitates browsing and inspection of the available metadata for candidate events extracted from the VLBA radio data.

79 ASTRONOMY AND ASTROPHYSICS↗

UV-TO-FIR ANALYSIS OF SPITZER/IRAC SOURCES IN THE EXTENDED GROTH STRIP. II. PHOTOMETRIC REDSHIFTS, STELLAR MASSES, AND STAR FORMATION RATES

Based on the ultraviolet to far-infrared photometry already compiled and presented in a companion paper (Paper I), we present a detailed spectral energy distribution (SED) analysis of nearly 80,000 IRAC 3.6 + 4.5 {mu}m selected galaxies in the Extended Groth Strip. We estimate photometric redshifts, stellar masses, and star formation rates (SFRs) separately for each galaxy in this large sample. The catalog includes 76,936 sources with [3.6] {<=} 23.75 (85% completeness level of the IRAC survey) over 0.48 deg{sup 2}. The typical photometric redshift accuracy is {Delta}z/(1 + z) = 0.034, with a catastrophic outlier fraction of just 2%. We quantify the systematics introduced by the use of different stellar population synthesis libraries and initial mass functions in the calculation of stellar masses. We find systematic offsets ranging from 0.1 to 0.4 dex, with a typical scatter of 0.3 dex. We also provide UV- and IR-based SFRs for all sample galaxies, based on several sets of dust emission templates and SFR indicators. We evaluate the systematic differences and goodness of the different SFR estimations using the deep FIDEL 70 {mu}m data available in the Extended Groth Strip. Typical random uncertainties of the IR-bases SFRs are a factor of two, with non-negligible systematic effects at z {approx}> 1.5 observed when only MIPS 24 {mu}m data are available. All data products (SEDs, postage stamps from imaging data, and different estimations of the photometric redshifts, stellar masses, and SFRs of each galaxy) described in this and the companion paper are publicly available, and they can be accessed through our the Web interface utility Rainbow-navigator.

79 ASTRONOMY AND ASTROPHYSICS↗

DuoModel: Leveraging Reduced Model for Data Reduction and Re-Computation on HPC Storage

High-performance computing (HPC) applications generate large amounts of floating-point data that need to be stored and analyzed efficiently to extract the insights and advance knowledge discovery. With the growing disparities between compute and I/O, optimizing the storage stack alone may not suffice to cure the I/O problem. There has been a strong push in the HPC communities to perform data reduction before data is transmitted to storage in order to lower the I/O cost. However, as of now, neither lossless nor lossy compressors can achieve the adequate reduction ratio that is desired by applications. This paper proposes DuoModel, a new approach that leverages the similarity between the full and reduced application models, and further improve the data reduction ratio. DouModel further improves the compression ratio of state-of-the-art compressors via compressing the differences (termed as delta) between the data products of the two models. For data analytics, the high fidelity data can be re-computed by launching the reduced model and applying the compressed delta. Our evaluations confirm that DuoModel can further push the limit of data reduction while the high fidelity of data is maintained.

Luo, Huizhang (ORCID:0000000323920267)↗

AbacusSummit: Cosmological N-body Halos, Light Cones, Particles, Merger Trees, Initial Conditions, and Power Spectra

This is the primary data release of the AbacusSummit, a suite of large, high-accuracy cosmological N-body simulations. Documentation describing the suite and code, including links to refereed publications and instructions for manipulating the data contained in this release, may be found at the following URL: https://abacussummit.readthedocs.io/ The primary data products presented in this release are halo catalogs, light cones, and particle data. Several supplemental products are also presented: power spectra, initial conditions, and merger trees. Cleaned halo catalogs are also provided for the subset of simulations that were used in refereed publications at the time of this DOI. This release also contains several large scale-free and high-redshift simulations run as part of the same allocation used to produce AbacusSummit.

79 ASTRONOMY AND ASTROPHYSICS↗

Scalable Analysis Methods and In Situ Infrastructure for Extreme Scale Knowledge Discovery

High performance computers have for many years been on a trajectory that gives them extraordinary compute power with the addition of more and more compute cores. At the same time, other system parameters such as the amount of memory per core and bandwidth to storage have remained constant or have barely increased. This creates an imbalance in the computer, giving it the ability to compute a lot of data that it cannot reasonably save out due to time and storage constraints. While technologies have been invented to mitigate this problem (burst buffers, etc.), software has been adapting to employ in situ libraries which perform data analysis and visualization on simulation data while it is still resident in memory. This avoids the need to ever have to pay the costs of writing many terabytes of data files. Instead, in situ enables the creation of more concentrated data products such as statistics, plots, and data extracts, which are all far smaller than the full-sized volume data. With the increasing popularity of in situ, multiple in situ infrastructures have been created, each with its own mechanism for integrating with a simulation. To make it easier to instrument a simulation with multiple in situ infrastructures and include custom analysis algorithms, this project created the SENSEI framework.

97 MATHEMATICS AND COMPUTING↗

BASIN-3D Data Integration for Selected ARM Data Field Campaign Report

The purpose of this data services request was to demonstrate integration of the Atmospheric Radiation Measurement (ARM) User Facility’s “met” datastreams with time series data from other earth science data sources using the BASIN-3D data synthesis software tool. BASIN-3D is an open-source Python library that enables researchers to integrate data across configured public and private data sources. It provides a common query language for researchers to request measurement locations and time series data based on specified locations, variables, time period, statistics, aggregation, and data quality. BASIN-3D acquires the data that match the query from each configured data source and translates the results into harmonized vocabularies, thus reducing researchers' data-wrangling effort. In addition, because the queries are executed on demand, researchers can easily regenerate their synthesized data sets as new data and/or data updates become available, eliminating one-off data products. BASIN-3D can output data using a variety of different data structures for end-user applications including Python pandas data frames and hdf5 output formats.

54 ENVIRONMENTAL SCIENCES↗

Scan-angle and Detector Effects in Thematic Mapper Radiometry

The performance of the Thematic Mapper (TM) as manifested by the quality of its image data is examined in order to suggest possible improvements for data production and assess the effects of data quality on its utility for land resources applications. The major emphasis is on the radiometric characteristics of TM data, with some attention to spatial and spectral characteristics.

Metzler, M. D.↗

Version 0 EOSDIS - An overview

Attention is given to NASA's Earth Observing System Data and Information System (EOSDIS), which is to be a single, distributed but internally consistent evolutionary system to support the planning and execution of EOS data acquisitions and to process, archive, and distribute EOS data products and selected non-EOS data to enable interdisciplinary studies of the earth. V0 EOSDIS, a logical step in this evolutionary process, is to address both technical and managerial challenges. Technical challenges include developing a multidiscipline, distributed system for searching and ordering data in a heterogeneous environment, and standardizing data formats and distribution techniques among differing communities and organizations. Managerial challenges include establishing and maintaining a structure consisting of geographically distributed entities such that cooperative development is carried out effectively despite organizational differences, maintaining interactions with the scientific community to ensure its close involvement despite its size and diversity, and keeping the expectations for V0 consistent with its schedules and resources.

Ramapriyan, H. K.↗

SeaWiFS technical report series. Volume 26: Results of the SeaWiFS Data Analysis Round-Robin, July 1994 (DARR-1994)

The accurate determination of upper ocean apparent optical properties (AOP's) is essential for the vicarious calibration of the sea-viewing wide field-of-view sensor (SeaWiFS) instrument and the validation of the derived data products. To evaluate the role that data analysis methods have upon values of derived AOP's, the first Data Analysis Round-Robin (DARR-94) workshop was sponsored by the SeaWiFS Project during 21-23 July, 1994. The focus of this intercomparison study was the estimation of the downwelling irradiance spectrum just beneath the sea surface, E(sub d)(0(sup -), lambda); the upwelling nadir radiance just beneath the sea surface, L(sub u)(0(sup -), lambda); and the vertical profile of the diffuse attenuation coefficient spectrum, K(sub d)(z, lambda). In the results reported here, different methodologies from four research groups were applied to an identical set of 10 spectroradiometry casts in order to evaluate the degree to which data analysis methods influence AOP estimation, and whether any general improvements can be made. The overall results of DARR-94 are presented in Chapter 1 and the individual methods of the four groups are presented in Chapters 2-5. The DARR-94 results do not show a clear winner among data analysis methods evaluated. It is apparent, however, that some degree of outlier rejection is required in order to accurately estimate L(sub u)(0(sup -), lambda) or E(sub d)(0(sup -), lambda). Furthermore, the calculation, evaluation and exploitation of confidence intervals for the AOP determinations needs to be explored. That is, the SeaWiFS calibration and validation problem should be recast in statistical terms where the in situ AOP values are statistical estimates with known confidence intervals.

Hooker, Stanford B.↗

The Two Micron All Sky Survey

The Two Micron All Sky Survey (2MASS) will provide a uniform survey of the entire sky at three near-infrared wavebands: J(lambda(sub eff) = 1.25 micrometers), H(lambda(sub eff) = 1.65 micrometers), and K(sub s)(lambda(sub eff) = 2.16 micrometers). A major goal of the survey is to probe large scale structures in the Milky Way and in the Local Universe, exploiting the relatively high transparency of the interstellar medium in the near-infrared, and the high near-infrared luminosities of evolved low- and intermediate-mass stars. A sensitive overview of the near-infrared sky is also an essential next step to maximize the gains achievable with infrared array technology. Our assessment of the astrophysical questions that might be addressed with these new arrays is currently limited by the very bright flux limit of the only preceding large scale near-infrared sky survey, the Two Micron Sky Survey carried out at Caltech in the late 1960's. Near-infrared instruments based on the new array technology have already obtained spectra of objects 1 million times fainter than the limit of the TMSS! This paper summarizes the essential parameters of the 2MASS project and the rationale behind those choices, and gives an overview of results obtained with a prototype camera that has been in operation since May 1992. We conclude with a list of expected data products and a statement of the data release policy.

Kleinmann, S. G.↗

The Plasmasphere as "Seen" by the IMAGE Mission

The Imager for Magnetopause-to-Aurora Global Exploration (IMAGE) is the first mission designed exclusively to remotely measure the magnetosphere. As such, it will reveal the ring current, plasmasphere, polar cusp, and magnetopause as whole extended, interacting systems. For the first time, our impressions of the global magnetosphere, synthesized through many years of whistler and in situ measurement, will be replaced by images. The overall morphology of each system of plasma and the correspondence of changes between them in response to the sun and solar wind will become available. The Extreme Ultraviolet Imager (EUV) and the Radio Plasma Imager (RPI) are the two IMAGE instruments which will remotely measure and image the plasmasphere. What we expect to "see" from these instruments and how it may be interpreted is the subject of this presentation. The EUV instrument includes three optical cameras, with an almost 90 degree field of view, transverse to the spin axis. EUV is designed to see He+ ions in resonantly scatter solar light at 30.4rim. The IMAGE spacecraft will spin with a period of about 2 minutes, with its spin axis parallel to the orbit normal. The IMAGE orbit will be highly inclined, with a high latitude apogee at a geocentric distance of 8RE and perigee of about 1.2RE. The normal observing integration time of 10 minutes will easily see to the outer edge of the plasmasphere. The RPI instrument makes use of three orthoganal dipole antennas: two in the spin plane with a tip-to-tip length of 500m and one along the spin axis with a length of 20 meters. Using coded pulse transmissions, the RPI instrument will broadcast from 3kHz to 3MHz. With one minute resolution, plasma densities from about 0.1 cm(exp -3) to 100,000 cm(exp -3), along with line-of-sight bulk velocities and locations, will be obtained from all returned radio wave signals. When transmitting from the high latitude magnetospheric cavity, RPI will measure density profiles for the major plasma structures in the magnetosphere, including the magnetopause, polar cusp, and plasmasphere. RPI should also see isolated density irregularities and possibly the plasma sheet. Observations The EUV instrument will return line-of-sight integrated images through the optically thin helium medium of the plasmasphere and magnetosphere. A variety of techniques have been suggested for the translation of the images into physically useful data, such as plasmapause location and three dimensional density distribution. The RPI instrument will return quantitative density values and line-of-sight velocity as a function of position along reflecting wave propagation paths. How they may be used individually and together to study plasmaspheric dynamics and global structure will be discussed. Attention will also be given to the data products and how access to IMAGE data will be provided by the IMAGE team and the NSSDC.

Gallagher, D. L.↗

A Software Architecture for Intelligent Synthesis Environments

The NASA's Intelligent Synthesis Environment (ISE) program is a grand attempt to develop a system to transform the way complex artifacts are engineered. This paper discusses a "middleware" architecture for enabling the development of ISE. Desirable elements of such an Intelligent Synthesis Architecture (ISA) include remote invocation; plug-and-play applications; scripting of applications; management of design artifacts, tools, and artifact and tool attributes; common system services; system management; and systematic enforcement of policies. This paper argues that the ISA extend conventional distributed object technology (DOT) such as CORBA and Product Data Managers with flexible repositories of product and tool annotations and "plug-and-play" mechanisms for inserting "ility" or orthogonal concerns into the system. I describe the Object Infrastructure Framework, an Aspect Oriented Programming (AOP) environment for developing distributed systems that provides utility insertion and enables consistent annotation maintenance. This technology can be used to enforce policies such as maintaining the annotations of artifacts, particularly the provenance and access control rules of artifacts-, performing automatic datatype transformations between representations; supplying alternative servers of the same service; reporting on the status of jobs and the system; conveying privileges throughout an application; supporting long-lived transactions; maintaining version consistency; and providing software redundancy and mobility.

Filman, Robert E.↗

Results of the Second SeaWiFS Data Analysis Round Robin, March 2000 (DARR-00)

The accurate determination of upper ocean apparent optical properties (AOPs) is essential for the vicarious calibration of the Sea-viewing Wide Field-of-view Sensor (SeaWiFS) instrument and the validation of the derived data products. To evaluate the importance of data analysis methods upon derived AOP values, the Second Data Analysis Round Robin (DARR-00) activity was planned during the latter half of 1999 and executed during March 2000. The focus of the study was the intercomparison of several standard AOP parameters: (1) the upwelled radiance immediately below the sea surface, L(sub u)(0(-),lambda); (2) the downward irradiance immediately below the sea surface, E(sub d)(0(-),lambda); (3) the diffuse attenuation coefficients from the upwelling radiance and the downward irradiance profiles, L(sub L)(lambda) and K(sub d)(lambda), respectively; (4) the incident solar irradiance immediately above the sea surface, E(sub d)(0(+),lambda); (5) the remote sensing reflectance, R(sub rs)(lambda); (6) the normalized water-leaving radiance, [L(sub W)(lambda)](sub N); (7) the upward irradiance immediately below the sea surface, E(sub u)(0(-)), which is used with the upwelled radiance to derive the nadir Q-factor immediately below the sea surface, Q(sub n)(0(-),lambda); and (8) ancillary parameters like the solar zenith angle, theta, and the total chlorophyll concentration, C(sub Ta), derived from the optical data through statistical algorithms. In the results reported here, different methodologies from three research groups were applied to an identical set of 40 multispectral casts in order to evaluate the degree to which differences in data analysis methods influence AOP estimation, and whether any general improvements can be made. The overall results of DARR-00 are presented in Chapter 1 and the individual methods used by the three groups and their data processors are presented in Chapters 2-4.

Hooker, Stanford B.↗

Exploiting the Capabilities of NASA's Giovanni System for Oceanographic Education

The NASA Goddard Earth Science Data and Information Services Center (GES DISC) Giovanni system [GES DISC Interactive Online Visualization ANd aNalysis Infrastructure] has significant capabilities for oceanographic education and independent research utilizing ocean color radiometry data products. Giovanni allows Web-based data discovery and basic analyses, and can be used both for guided illustration of a variety of marine processes and phenomena, and for independent research investigations. Giovanni's capabilities are particularly suited for advanced secondary school science and undergraduate (college) education. This presentation will describe a variety of ways that Giovanni can be used for oceanographic education. Auxiliary information resources that can be utilized will also be described. Several testimonies of Giovanni usage for instruction will be provided, and a recent case history of Giovanni utilization for instruction and research at the undergraduate level is highlighted.

Acker, James G.↗