Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “scientific data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

The NASA Ames Life Sciences Data Archive: Biobanking for the Final Frontier

The NASA Ames Institutional Scientific Collection involves the Ames Life Sciences Data Archive (ALSDA) and a biospecimen repository, which are responsible for archiving information and non-human biospecimens collected from spaceflight and matching ground control experiments. The ALSDA also manages a biospecimen sharing program, performs curation and long-term storage operations, and facilitates distribution of biospecimens for research purposes via a public website (https:lsda.jsc.nasa.gov). As part of our best practices, a tissue viability testing plan has been developed for the repository, which will assess the quality of samples subjected to long-term storage. We expect that the test results will confirm usability of the samples, enable broader science community interest, and verify operational efficiency of the archives. This work will also support NASA open science initiatives and guides development of NASA directives and policy for curation of biological collections.

Biobank↗

MER SPICE Interface

MER SPICE Interface is a software module for use in conjunction with the Mars Exploration Rover (MER) mission and the SPICE software system of the Navigation and Ancillary Information Facility (NAIF) at NASA's Jet Propulsion Laboratory. (SPICE is used to acquire, record, and disseminate engineering, navigational, and other ancillary data describing circumstances under which data were acquired by spaceborne scientific instruments.) Given a Spacecraft Clock value, MER SPICE Interface extracts MER-specific data from SPICE kernels (essentially, raw data files) and calculates values for Planet Day Number, Local Solar Longitude, Local Solar Elevation, Local Solar Azimuth, and Local Solar Time (UTC). MER SPICE Interface was adapted from a subroutine, denoted m98SpiceIF written by Payam Zamani, that was intended to calculate SPICE values for the Mars Polar Lander. The main difference between MER SPICE Interface and m98SpiceIf is that MER SPICE Interface does not explicitly call CHRONOS, a time-conversion program that is part of a library of utility subprograms within SPICE. Instead, MER SPICE Interface mimics some portions of the CHRONOS code, the advantage being that it executes much faster and can efficiently be called from a pipeline of events in a parallel processing environment.

Sayfi, Elias↗

Technology Assessment of High Capacity Data Storage Systems: Can We Avoid a Data Survivability Crisis?

This technology assessment of long-term high capacity data storage systems identifies an emerging crisis of severe proportions related to preserving important historical data in science, healthcare, manufacturing, finance and other fields. For the last 50 years, the information revolution, which has engulfed all major institutions of modem society, centered itself on data-their collection, storage, retrieval, transmission, analysis and presentation. The transformation of long term historical data records into information concepts, according to Drucker, is the next stage in this revolution towards building the new information based scientific and business foundations. For this to occur, data survivability, reliability and evolvability of long term storage media and systems pose formidable technological challenges. Unlike the Y2K problem, where the clock is ticking and a crisis is set to go off at a specific time, large capacity data storage repositories face a crisis similar to the social security system in that the seriousness of the problem emerges after a decade or two. The essence of the storage crisis is as follows: since it could take a decade to migrate a peta-byte of data to a new media for preservation, and the life expectancy of the storage media itself is only a decade, then it may not be possible to complete the transfer before an irrecoverable data loss occurs. Over the last two decades, a number of anecdotal crises have occurred where vital scientific and business data were lost or would have been lost if not for major expenditures of resources and funds to save this data, much like what is happening today to solve the Y2K problem. A pr-ime example was the joint NASA/NSF/NOAA effort to rescue eight years worth of TOVS/AVHRR data from an obsolete system, which otherwise would have not resulted in the valuable 20-year long satellite record of global warming. Current storage systems solutions to long-term data survivability rest on scalable architectures having parallel paths for data migration.

Halem, M.↗

Position Papers for Inverse Methods for Complex Systems under Uncertainty Workshop

The ability to solve inverse problems – inferring unknown parameters, structures, or states of a system from observed data – is essential for advancing scientific discovery and innovation capabilities for the DOE mission. Basic research needs and challenges are particularly acute in emerging areas such as the interactive, data-driven, modeling and simulation of digital twins; decision support for experiments at DOE scientific user facilities; and for other complex systems and workflows. Inverse problems are at the heart of understanding and controlling complex systems due to factors such as observational data with varying modalities and fidelities, inherent uncertainties in physical measurements and numerical models, and the computational demands of rapid and high-fidelity simulations. The convergence of recent scientific computing trends – scientific machine learning, artificial intelligence, and computing advances such as exascale computing – is creating unprecedented opportunities. These advancements offer the potential to revolutionize how we approach inverse problems to extract actionable insights with the required level of accuracy and computational efficiency. This workshop and the Call for Position Papers are vital steps in bringing together experts to collectively explore and identify the new computational and mathematical directions needed in inverse methods for complex systems under uncertainty.

97 MATHEMATICS AND COMPUTING↗

Memory-Aware External Facelist Calculation: A Data-Parallel Atomic Hash Counting Approach

Unstructured volumetric meshes serve as fundamental data representations in various scientific simulations and analyses. They play a crucial role in representing complex computational domains and are essential for important numerical techniques, such as finite element analysis. Whenever such a mesh is read from a file, streamed in-situ, or generated by algorithms, scientific visualization libraries rely on calculating the external surface of a geometry, named “external facelist”, to produce a polygonal mesh for rendering. Consequently, external facelist calculation has become one of the most widely used algorithms in the scientific visualization domain, necessitating optimal performance. In this paper, we explore relevant work on external facelist calculation algorithms in two common visualization libraries, VTK and Viskores, assess their performance and memory constraints, and introduce a novel memory-aware external facelist calculation algorithm employing an atomic hash counting approach. This algorithm fully leverages Viskores' data-parallel primitive operations, facilitating its execution across diverse many-core architectures. Our algorithm features the lowest memory footprint on the GPU and the second-lowest on the CPU among all evaluated methods, and it also delivers the fastest performance on both CPU and GPU. It has been made available under an open-source license in the VTK and Viskores visualization systems.

Tsalikis, Spiros [Kitware] (ORCID:0000000151137195↗

Validating a large geophysical data set: Experiences with satellite-derived cloud parameters

We are validating the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and are using the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The data handling needed for this work is possible only with the help of a suite of interactive graphical and numerical analysis tools. Level 3 (gridded) data is the common form in which large data sets of this type are distributed for scientific analysis. We find that Level 3 data is inadequate for the data comparisons required for validation. Level 2 data (individual measurements in geophysical units) is needed. A sampling problem arises when individual measurements, which are not uniformly distributed in space or time, are used for the comparisons. Standard 'interpolation' methods involve fitting the measurements for each data set to surfaces, which are then compared. We are experimenting with formal criteria for selecting geographical regions, based upon the spatial frequency and variability of measurements, that allow us to quantify the uncertainty due to sampling. As part of this project, we are also dealing with ways to keep track of constraints placed on the output by assumptions made in the computer code. The need to work with Level 2 data introduces a number of other data handling issues, such as accessing data files across machine types, meeting large data storage requirements, accessing other validated data sets, processing speed and throughput for interactive graphical work, and problems relating to graphical interfaces.

Kahn, Ralph↗

DITDOS: A set of design specifications for distributed data inventories

The analysis of space science data often requires researchers to work with many different types of data. For instance, correlative analysis can require data from multiple instruments on a single spacecraft, multiple spacecraft, and ground-based data. Typically, data from each source are available in a different format and have been written on a different type of computer, and so much effort must be spent to read the data and convert it to the computer and format that the researchers use in their analysis. The large and ever-growing amount of data and the large investment by the scientific community in software that require a specific data format make using standard data formats impractical. A format-independent approach to accessing and analyzing disparate data is key to being able to deliver data to a diverse community in a timely fashion. The system in use at the Planetary Plasma Interactions (PPI) node of the NASA Planetary Data System (PDS) is based on the object-oriented Distributed Inventory Tracking and Data Ordering Specification (DITDOS), which describes data inventories in a storage independent way. The specifications have been designed to make it possible to build DITDOS compliant inventories that can exist on portable media such as CD-ROM's. The portable media can be moved within a system, or from system to system, and still be used without modification. Several applications have been developed to work with DITDOS compliant data holdings. One is a windows-based client/server application, which helps guide the user in the selection of data. A user can select a data base, then a data set, then a specific data file, and then either order the data and receive it immediately if it is online or request that it be brought online if it is not. A user can also view data by any of the supported methods. DITDOS makes it possible to use already existing applications for data-specific actions, and this is done whenever possible. Another application is a stand-alone tool to assist in the extraction of data from portable media, such as CD-ROM's. In addition to the applications, there is a set of libraries that can facilitate building new DITDOS compliant applications.

King, T. A.↗

Collaborative Platforms Aid Emergency Decision Making

Terra. Aqua. Cloudsat. Landsat. NASA runs and partners in many missions dedicated to monitoring the Earth, and the tools used in these missions continuously return data on everything from shifts in temperature to cloud formation to pollution levels over highways. The data are of great scientific value, but they also provide information that can play a critical role in decision making during times of crisis. Real-time developments in weather, wind, ocean currents, and numerous other conditions can have a significant impact on the way disasters, both natural and human-caused, unfold. "NASA has long recognized the need to make its data from real-time sources compatible and accessible for the purposes of decision making," says Michael Goodman, who was Disasters Program manager at NASA Headquarters from 2009-2012. "There are practical applications of NASA Earth science data, and we d like to accelerate the use of those applications." One of the main obstacles standing in the way of eminently practical data is the fact that the data from different missions are collected, formatted, and stored in different ways. Combining data sets in a way that makes them useful for decision makers has proven to be a difficult task. And while the need for a collaborative platform is widely recognized, very few have successfully made it work. Dave Jones, founder and CEO of StormCenter Communications Inc., which consults with decision makers to prepare for emergencies, says that "when I talk to public authorities, they say, If I had a nickel for every time someone told me they had a common operating platform, I d be rich. But one thing we ve seen over the years is that no one has been able to give end users the ability to ingest NASA data sets and merge them with their own."

Source record↗

Herschel and the Molecular Universe

Over the next decade, space-based missions will open up the universe to high spatial and spectral resolution studies at infrared and submillimeter wavelengths. This will allow us to study, in much greater detail, the composition and the origin and evolution of molecules in space. Moreover, molecular transitions in these spectral ranges provide a sensitive probe of the dynamics and the physical and chemical conditions in a wide range of objects at scales ranging from budding planetary systems to galactic and extragalactic sizes. Hence, these missions provide us with the tools to study key astrophysical and astrochemical processes involved in the formation and evolution of planets, stars, and galaxies. These new missions can be expected to lead to the detection of many thousands of new spectral features. Identification, analysis and interpretation of these features in terms of the physical and chemical characteristics of the astronomical sources will require detailed astronomical modeling tools supported by laboratory measurements and theoretical studies of chemical reactions and collisional excitation rates on species of astrophysical relevance. These data will have to be made easily accessible to the scientific community through web-based data archives. In this paper, we will review the Herschel mission and its expected impact on our understanding of the molecular universe.

Tielens, A. G. G. M.↗

Vector-bundle classes form powerful tool for scientific visualization

A vector-bundle data model is considered focusing on the mathematical structure of vector bundles and the object oriented implementation of the model. It is demonstrated that the object-oriented paradigm provides a number of mechanisms for capturing scientific abstractions directly in the code. The object-oriented approach is considered to be capable of substantially increasing the level of abstraction in future scientific codes.

Butler, David M.↗

Terrestrial bodies orbiter, LUNAR - A system for detailed global measurements of a planet's properties

The NASA Lunar Polar Orbiter, to be launched by a Delta vehicle in 1980, is designed to perform a global exploration of such moon properties as the gravity field, figure, and surface composition, as well as a lunar resource survey. The paper reviews the mission, spacecraft, and data system concepts in terms of baseline mission sequence, choice of orbits, spacecraft configuration requirements, mission sequence requirements and data system and operations. Scientific experiments planned for the Orbiter mission include geophysical altimetry and gravity experiments, heat flow experiment, magnetic field experiments, measurements of the moon's natural gamma-ray spectrum, X-ray fluorescence of lunar surface materials, sunlight reflectance spectroscopy, and spectro-stereo imaging. Characteristics of instruments designed for use in these investigations are examined. Through the use of advanced sensors and data-system techniques, coupled with well-developed spacecraft systems, the mission promises to return a very large quantity and variety of lunar data at a cost comparable with that of simpler missions in the past.

Burke, J. D.↗

Magellan stereo images and Venusian geology

Areas of Venus imaged by Magellan radar with multiple viewing conditions provide unique data that will contribute to the solution of venusian geologic problems and provide a basis for quantitative comparison of venusian landforms with those on other planetary bodies. Three sets of images with different viewing conditions have been acquired: (1) left-looking with variable incidence angles (cycle 1 profile), (2) right-looking with nearly constant incidence angles (cycle 2 profile), and (3) left-looking with variable incidence angles that are almost always smaller than those in (1) (cycle 3 profiles). The unique data provided by paired images of the same scene with different incidence angles arises from image displacements caused by the relief of individual landforms at scales comparable to the ground-range and azimuth resolutions of the images. There are two aspects of the data: (1) Stereopsis achieved by simultaneous viewing of paired left-looking images of the same scene permits three-dimensional perception and interpretation of the morphologies of landforms at resolutions much finer than the altimetry footprints. (2) Measurements of differences of image displacements (parallax) on paired images with known imaging geometries provide quantitative estimates of the relief and shapes of landforms. The potential scientific contributions of the data can be grouped into two interrelated classes: (A) geologic mapping, analysis, and interpretation and (B) topical studies that involve topographic measurements. Stereopsis, without quantitative measurements, enhances geologic mapping, analysis, and interpretation of the rock units of Venus to a degree that cannot be overestimated. In geologic mapping, assemblages of landforms, assessments of backscatter and variations in backscatter, and fine-scale topography are used to define and characterize geologic map units that represent laterally continuous deposits or rock units. Stereopsis adds the important dimension of local relief for characterization of geologic units at a scale that is not possible with Magellan altimetry or products derived from the altimetry. Relative ages of the geologic units are determined using the well-known principles of superposition and intersection. Here, the perception of relief is invaluable because superposition relations among the geological units are more readily and clearly established. The recognition of folds, faults, and fault systems, regardless of their orientations, is facilitated with stereopsis so that sequences of deformation of the geologic units can be determined and structural analyses vastly improved. Shapes of landforms are readily perceived so that they can be properly interpreted. The end result of the mapping, analyses, and interpretations is a geologic history of Venus that includes the sequences of formation and deformation of various geologic units. Measurements of relief at the finest scale possible are necessary for numerous topical studies. Standard altimetry will provide the necessary information on the relief of most large landforms, but it tends to underestimate the relief of small landforms and distorts their shapes. Although special processing of the altimeter echoes improves the estimates of the relief and shapes of some landforms, there are uncertainties in the interpretations of the echoes. Examples of topical studies requiring measurements of relief are given.

Moore, H. J.↗

Developing a simulator-based satellite dataset for using machine learning techniques to derive aerosol-cloud-precipitation interactions in models and observations in a consistent framework

Aerosol-cloud-precipitation interactions (ACPI) remain a major uncertainty in understanding the Earth’s radiation budget and water cycle (including extremes). After decades of active research, various observationally based metrics have been developed to constrain ACPI in Earth System Models (ESMs), but direct comparison of model and data estimates can confound scientific understanding because limitations and uncertainties in sampling and retrieval procedures may combine with model deficiencies in process representations of ACPI to obstruct understanding. Furthermore, conventional ACPI metrics often vary from one regime to another, and the ACPI process representation in ESMs is also typically derived based on only a limited area/regime (even though the parameterization applies globally). To bridge the gap between models and data and to correctly describe ACPI in all regimes, we propose to construct a new CALIPSO-CloudSat merged dataset that is produced by the same algorithms used in satellite simulators in ESMs, and to use machine learning techniques to derive new ACPI metrics that can be accurately estimated by satellites and can provide meaningful constraints on cloud microphysical process representations in ESMs. The dataset will include measured and retrieved variables for aerosol, cloud, and precipitation from CALIPSO and CloudSat, and environmental variables from meteorological reanalysis. The data will be used to train a neural network to construct the ACPI metrics as a function of environmental conditions. The new ACPI formula will be used to constrain the ACPI in the Energy Exascale Earth System Model (E3SM), and to augment/reformulate the ACPI process representation in the E3SM to improve the simulation of the evolution of the atmosphere under different environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

AI-Ready Data Pilot Project Report

The proliferation of artificial intelligence in scientific research has created an urgent need to define "AI-ready data" for researchers and, more importantly, provide resources to help them produce AI-ready data. At Pacific Northwest National Laboratory, we conducted a pilot study with three data scientists evaluating three CSV datasets from different scientific domains, followed by semi-structured interviews capturing assessment practices. Our findings reveal that AI-readiness evaluation is intuition-based, with practitioners asking "How fast can I go from raw data to my machine learning pipeline?" Data scientists consistently prioritized workflow efficiency, human interpretability, and quality stewardship signals. From these insights, we developed a practical evaluation framework comprising data requirements, metadata standards, and validation tests that provides actionable criteria for producing and curating AI-ready datasets, addressing the gap between theoretical understanding and practical implementation.

97 MATHEMATICS AND COMPUTING↗

Reducing Surface Clutter in Cloud Profiling Radar Data

An algorithm has been devised to reduce ground clutter in the data products of the CloudSat Cloud Profiling Radar (CPR), which is a nadir-looking radar instrument, in orbit around the Earth, that measures power backscattered by clouds as a function of distance from the instrument. Ground clutter contaminates the CPR data in the lowest 1 km of the atmospheric profile, heretofore making it impossible to use CPR data to satisfy the scientific interest in studying clouds and light rainfall at low altitude. The algorithm is based partly on the fact that the CloudSat orbit is such that the geodetic altitude of the CPR varies continuously over a range of approximately 25 km. As the geodetic altitude changes, the radar timing parameters are changed at intervals defined by flight software in order to keep the troposphere inside a data-collection time window. However, within each interval, the surface of the Earth continuously "scans through" (that is, it moves across) a few range bins of the data time window. For each radar profile, only few samples [one for every range-bin increment ((Delta)r = 240 m)] of the surface-clutter signature are available around the range bin in which the peak of surface return is observed, but samples in consecutive radar profiles are offset slightly (by amounts much less than (Delta)r) with respect to each other according to the relative change in geodetic altitude. As a consequence, in a case in which the surface area under examination is homogenous (e.g., an ocean surface), a sequence of consecutive radar profiles of the surface in that area contains samples of the surface response with range resolution (Delta)p much finer than the range-bin increment ((Delta)p << r). Once the high-resolution surface response has thus become available, the profile of surface clutter can be accurately estimated by use of a conventional maximum-correlation scheme: A translated and scaled version of the high-resolution surface response is fitted to the observed low-resolution profile. The translation and scaling factors that optimize the fit in a maximum-correlation sense represent (1) the true position of the surface relative to the sampled surface peak and (2) the magnitude of the surface backscatter. The performance of this algorithm has been tested on CloudSat data acquired over an ocean surface. A preliminary analysis of the test data showed a surface-clutter-rejection ratio over flat surfaces of >10 dB and a reduction of the contaminated altitude over ocean from about 1 km to about 0.5 km (over the ocean). The algorithm has been embedded in CloudSat L1B processing as of Release 04 (July 2007), and the estimated flat surface clutter is removed in L2B-GEOPROF product from the observed profile of reflectivity (see CloudSat product documentation for details and performance at http://www.cloudsat.cira.colostate.edu/ dataSpecs.php?prodid=1).

Tanelli, Simone↗

Comparing the Ocean Color Measurements Between MOS and SeaWiFS: A Vicarious Intercalibration Approach for MOS

One of the primary goals of the NASA Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project is to develop methods for meaningful comparison and possible merging of data products from multiple ocean color missions. The Modular Optoelectronic Scanner (MOS) is a German instrument that was launched in the spring of 1996 on the Indian IRS-P3 satellite. With the successful launch of NASA's Sea-viewing Wide Field-of-view Sensor (SeaWiFS) in the summer of 1997, there are now two ocean color missions in concurrent operation and there is interest within the scientific community to compare data from these two sensors. In this paper, we describe our efforts to retrieve ocean optical properties from both SeaWiFS and MOS using consistent methods. We first briefly review the atmospheric correction, which removes more than 90% of the observed radiances in the visible, and then describe how the atmospheric correction algorithm used for the SeaWiFS data can be modified for application to other ocean color sensors. Next, since the retrieved water-leaving radiances in the visible between MOS and SeaWiFS are significantly different, we developed a vicarious intercalibration method to recalibrate the MOS spectral bands based on the optical properties of the ocean and atmosphere derived from the coincident SeaWiFS measurements. We present and discuss the MOS retrieved ocean optical properties before and after the vicarious calibration, and demonstrate the efficacy of this approach. We show that it is possible and efficient to vicariously intercalibrate sensors between one and another.

Wang, Menghua↗

MESSENGER, MErcury: Surface, Space ENvironment, GEochemistry, and Ranging; A Mission to Orbit and Explore the Planet Mercury

MESSENGER is a scientific mission to Mercury. Understanding this extraordinary planet and the forces that have shaped it is fundamental to understanding the processes that have governed the formation, evolution, and dynamics of the terrestrial planets. MESSENGER is a MErcury Surface, Space ENvironment, GEochemistry and Ranging mission to orbit Mercury for one Earth year after completing two flybys of that planet following two flybys of Venus. The necessary flybys return significant new data early in the mission, while the orbital phase, guided by the flyby data, enables a focused scientific investigation of this least-studied terrestrial planet. Answers to key questions about Mercury's high density, crustal composition and structure, volcanic history, core structure, magnetic field generation, polar deposits, exosphere, overall volatile inventory, and magnetosphere are provided by an optimized set of miniaturized space instruments. Our goal is to gain new insight into the formation and evolution of the solar system, including Earth. By traveling to the inner edge of the solar system and exploring a poorly known world, MESSENGER fulfills this quest.

Source record↗

Field Micrometeorological Measurements, Process-Level Studies and Modeling of Methane and Carbon Dioxide Fluxes in a Boreal Wetland Ecosystem

The main instrumentation platform consisted of eddy correlation sensors mounted on a scaffold tower at a height of 4.2 m above the peat surface. The sensors were attached to a boom assembly which could be rotated into the prevailing winds. The boom assembly was mounted on a movable sled which, when extended, allowed sensors to be up to 2 m away from the scaffolding structure to minimize flow distortion. When retracted, the sensors could easily be installed, serviced or rotated. An electronic level with linear actuators allowed the sensors to be remotely levelled once the sled was extended. Two instrument arrays were installed. A primary (fast-response) array consisted of a three-dimensional sonic anemometer, a methane sensor (tunable diode laser spectrometer), a carbon dioxide/water vapor sensor, a fine wire thermocouple and a backup one-dimensional sonic anemometer. The secondary array consisted of a one-dimensional sonic anemometer, a fine wire thermocouple and a Krypton hygrometer. Descriptions of these sensors may be found in other reports (e.g., Verma; Suyker and Verma). Slow-response sensors provided supporting measurements including mean air temperature and humidity, mean horizontal windspeed and direction, incoming and reflected solar radiation, net radiation, incoming and reflected photosynthetically active radiation (PAR), soil heat flux, peat temperature, water-table elevation and precipitation. A data acquisition system (consisting of an IBM compatible microcomputer, amplifiers and a 16 bit analog-to-digital converter), housed in a small trailer, was used to record the fast response signals. These signals were low-pass filtered (using 8-pole Butterworth active filters with a 12.5 Hz cutoff frequency) and sampled at 25 Hz. Slow-response signals were sampled every 5 s using a network of CR21X (Campbell Scientific, Inc., Logan Utah) data loggers installed in the fen. All signals were averaged over 30-minute periods (runs).

Verma, S. B.↗