Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data lake”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗
NASA NTRS1987

Propagation of electrons emitting weak type III bursts in coronal streamers

The observations of weak type III bursts at 73.8, 57.5, 50.0, and 38.5 MHz from Clark Lake Radio Observatory on four days are reported and their characteristics are discussed. In addition to Clark Lake data, the magnetogram and sunspot/active region data and the coronal streamer data obtained by HAO's Coronagraph/Polarimeter aboard SMM satellite are used to study the location of the burst sources with respect to the coronal streamers emanating from active regions. It is shown that the bursts occur within or close to the edge of dense coronal streamers implying that the coronal streamers contain open magnetic field lines along which the electrons generating the bursts propagate. The positional analysis of the bursts is used to estimate the variation of coronal electron density with radial distance.

Gopalswamy, N.↗
NASA NTRSDate not supplied

Advanced Information Systems Technology for NASA Earth System Digital Twins (ESDT)

ESA and NASA have both started programs to design and develop Digital Twins of the Earth and/or Earth systems. Organized around interconnected, multi-domain, high-scale modeling capabilities, the three major components of an Earth System Digital Twin are a continuously updated Digital Replica of the Earth System of interest, dynamic Forecasting models, and Impact Assessment capabilities. Earth System Digital Twins integrate diverse Earth and human activity models, continuous observations, and information system capabilities to provide unified, comprehensive representations and predictions that can be utilized for monitoring the health of the Planet, as well as for developing actionable information to support decision making. More generally, Digital Twins will help researchers better understand the fundamental Earth systems that impact everything from wildfires to climate change. This Townhall will first provide a short description of ESA’s, NASA’s and CNES’s current efforts in Digital Twins: • Destination Earth (DestinE) is the first initiative of the European Union to create a Digital Twin of the Earth, particularly focused on weather and climate, and as a coordinated effort between the European Centre for Medium-Range Weather Forecasts (ECMWF), ESA and the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT). • Additionally, ESA is developing several Digital Twin Earth Precursor Activities to study some of the key scientific and technical challenges associated with building a “Digital Twin Earth”. These include forests, hydrology, Antarctica, food systems, oceans, and climate hot spots Digital Twin prototypes. • NASA Earth Science Technology Office (ESTO)’s Advanced Information Systems Technology (AIST) Program has started an initiative in Earth System Digital Twins (ESDT), with 14 current projects in this area, developing various information systems technologies and prototypes that will help prepare the development of future NASA Digital Twins. • CNES is currently developing the concept of a Digital Twin Factory (DTF), which relies on a data lake, a high computing capability using clouds and/or HPC and has thematic algorithms and methodologies able to generate registered and coherent layers of information in order to enrich a datacube from which physical indicators can be computed spatially. NASA, ESA and CNES are also currently defining science use cases that will be presented during the townhall; those and a few short discussions of current projects will serve as a starting point to engage a dialogue about Digital Twins of the Earth with the IGARSS community.

earth science remote sensing; Information systems↗
NASA NTRS2008

In-Flight Validation of Mid and Thermal Infrared Remotely Sensed Data Using the Lake Tahoe and Salton Sea Automated Validation Sites

The presentation includes an introduction, Lake Tahoe site layout and measurements, Salton Sea site layout and measurements, field instrument calibration and cross-calculations, data reduction methodology and error budgets, and example results for MODIS. Summary and conclusions are: 1) Lake Tahoe CA/NV automated validation site was established in 1999 to assess radiometric accuracy of satellite and airborne mid and thermal infrared data and products. Water surface temperatures range from 4-25C.2) Salton Sea CA automated validation site was established in 2008 to broaden range of available water surface temperatures and atmospheric water vapor test cases. Water surface temperatures range from 15-35C. 3) Sites provide all information necessary for validation every 2 mins (bulk temperature, skin temperature, air temperature, wind speed, wind direction, net radiation, relative humidity). 4) Sites have been used to validate mid and thermal infrared data and products from: ASTER, AATSR, ATSR2, MODIS-Terra, MODIS-Aqua, Landsat 5, Landsat 7, MTI, TES, MASTER, MAS. 5) Approximately 10 years of data available to help validate AVHRR.

Lake Tahoe↗
NASA NTRS1979

Improvements in lake water budget computations using Landsat data

A supervised multispectral classification was performed on Landsat data for Lake Okeechobee's extensive littoral zone to provide two types of information. First, the acreage of a given plant species as measured by satellite was combined with a more accurate transpiration rate to give a better estimate of evapotranspiration from the littoral zone. Second, the surface area coupled by plant communities was used to develop a better estimate of the water surface as a function of lake stage. Based on this information, more detailed representations of evapotranspiration and total water surface (and hence total lake volume) were provided to the water balance budget model for lake volume predictions. The model results based on information derived from satellite demonstrated a 94 percent reduction in cumulative lake stage error and a 70 percent reduction in the maximum deviation of the lake stage.

Gervin, J. C.↗
NASA NTRS1994

Analysis of ERS 1 synthetic aperture radar data of frozen lakes in northern Montana and implications for climate studies

Lakes that freeze each winter are good indicators of regional climate change if key parameters, such as freeze-up and breakup date and maximum ice thickness, are measured over a decade-scale time frame. Synthetic aperture radar (SAR) satellite data have proven to be especially useful for measurement of climatologically significant parameters characteristic of frozen lakes. In this paper, five lakes in Glacier National Park, Montana, have been studied both in the field and using Earth Remote-Sensing Satellite (ERS) 1 SAR data during the 1992-1993 winter. The lakes are characterized by clear ice, sometimes with tubular or rounded bubbles, and often with a layer of snow ice on top of the clear ice. They are also often snow covered. Freeze-up is detected quite easily using ERS 1 SAR data as soon as a thin layer of ice forms. The effect of snow ice on the backscatter is thought to be significant but is, as yet, undetermined. On the five lakes studied, relative backscatter was found to increase with ice thickness until a maximum was reached in February. Breakup, an often ill-defined occurrence, is difficult to detect because surface water causes the SAR signal to be absorbed, thus masking the ice below. Comparison of the bubble structure of thaw lakes in northern Alaska with lakes in northern Montana has shown that the ice structure is quite different, and this difference may contribute to differential SAR signature evolution in the lakes of the two areas.

Hall, Dorothy K.↗
NASA NTRS1976

Utilization of satellite data for inventorying prairie ponds and lakes

ERTS-1 data were used in mapping open surface water features in the glaciated prairies. Emphasis was placed on the recognition of these features based upon water's uniquely low radiance in a single near-infrared waveband. On the basis of these results, thematic maps and statistics relating to open surface water were obtained. In a related effort, the added information content of multiple spectral wavebands was used for discriminating surface water at a level of detail finer than the virtual resolution of the data. The basic theory of this technique and some preliminary results are described.

Work, E. A., Jr.↗
NASA NTRS1975

Turbidity in extreme western Lake Superior

Data were obtained from ERTS images for western Lake Superior for 1972-74. Data examination showed that for easterly winds the turbidity originating along the Wisconsin shore and the resuspension areas are transported northward then out along a N.E. path where it disperses, and often, for large storms, contaminates the Duluth water intake. Contaminants such as dredging fines anywhere along these paths would likewise find their way to the intake areas in concentrations comparable to the relative red clay concentration.

Sydor, M.↗
NASA NTRS1976

A computer analysis of ERTS data of the Lake Gregory area of South Australia with particular emphasis on its role in terrain classification for engineering

A digital computer and multivariate statistical techniques were used to analyze 4-band multispectral data. A representation of the original data for each of the four bands allows a certain degree of terrain interpretation; however, variations in appearance of sites within and between bands, without additional criteria for deciding which representation should be preferred, create difficulties for classification. Investigation of the video data groups produced by principal components analysis and cluster analysis techniques shows that effective correlations with classifications of terrain produced by conventional methods could be carried out. The analyses also highlighted underlying relationships between the various elements. The approach used allows large areas (185 cm by 185 cm) to be classified into fundamental units within a matter of hours and can be applied to those parts of the Earth where facilities for conventional studies are poor or lacking.

Lodwick, G. D.↗
NASA NTRS2011

Forecasting Lake-Effect Snow in the Great Lakes Using NASA Satllite Data

This slide presentation reviews the forecast of the lake effect snow in the Great Lakes region using models and infrared estimates of Great Lake Surface Temperatures (GLSTs) from the MModerate Resolution Imaging Spectroradiometer (MODIS) instrument on Terra and Aqua satellites, and other satellite data. This study analyzes Lake Erie and Lake Ontario which produce storm total snowfall ranged from 8-18 inches off of Lake Ontario and 10-12 inches off of Lake Erie for the areas downwind.

Cipullo, Michelle↗
NASA NTRS1974

Automatic classification of eutrophication of inland lakes from spacecraft data

The author has identified the following significant results. Spacecraft data and computer techniques can be used to rapidly map and store onto digital tapes watershed land use information. Software is now available by which this land use information can be rapidly and economically extracted from the tapes and related to coliform counts and other lake contaminants (e.g. phosphorus). These tools are basic elements for determining those land use factors and sources of nutrients that accelerate eutrophication in lakes and reservoirs.

Rogers, R. H.↗
NASA NTRS1981

Statewide lake classification utilizing LANDSAT imagery for the state of Wisconsin

A cooperative program between the Wisconsin Department of Natural Resources and the University of Wisconsin-Madison resulted in the assessment of the trophic condition of approximately 3,000 significant inland lakes in Wisconsin. The feasibility of using both photographic and digital representations of LANDSAT multispectral scanner data for lake classification was investigated. The result was the development of a nearly automated system which, with minimal human interaction, locates and extracts the lake data, then corrects the data for atmospheric effects, and finally classifies all the significant lakes in the state as to trophic condition.

Martin, R. H.↗
NASA NTRS1972

The use of ERTS-1 satellite data in Great Lakes mesometeorological studies

The author has identified the following significant results. In the original proposal, it was hoped that ERTS could, with its extremely high resolution and multispectral capability, detect many meteorological phenomena occurring at the low end of the mesoscale motion spectrum (1 - 100 km). This included convective cloud phenomena, internal wave patterns, air pollution, snow squalls, etc. For meteorologists, ERTS-1 has more than lived up to initial hopes. First-look inspection of images has produced a large number of truly remarkable finds. Some of the most significant are: (1) Images of Lake Ontario during late summer have revealed several extremely good examples of lake breeze frontal cloud patterns. (2) Detection of suspended particulates from Chicago-Gary industrial complex in the 50,000 to 150,000 tons/year category. (3) Inadvertant weather modification due to anthropogenic condensation and ice nuclei from urban areas.

Lyons, W. A.↗
NASA NTRS1993

Estimating chlorophyll content and bathymetry of Lake Tahoe using AVIRIS data

Data on chlorophyll content and bathymetry of Lake Tahoe obtained on August 9, 1990 by the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) are compared to concurrent in situ surface and in-water measurements. Measured parameters included profiles of percent transmission of monochromatic light, stimulated chlorophyll fluorescence, photosynthetically available radiation, spectral upwelling and downwelling irradiance, and upwelling radiance. Several analyses were performed illustrating the utility of the AVIRIS over a dark water scene. Image-derived chlorophyll concentration compared extremely well with that measured with bottle samples. A bathymetry map of the shallow parts of the lake was constructed which compares favorably with published lake soundings.

Hamilton, Michael K.↗
NASA NTRS2019

New Estimates of Ice and Oxygen Fluxes Across the Entire Lid of Lake Vostok From Observations of Englacial Radio Wave Attenuation

Over deep Antarctic subglacial lakes, spatially varying ice thickness and the pressure‐dependent melting point of ice result in distinct areas of melting and freeze‐on at the ice‐water interface, that is, at the lake lid. These ice mass fluxes drive lake circulation and, because basal Antarctic ice contains air clathrate, affect the input of oxygen to the lake, with implications for subglacial life. Inferences of rates of melting and freeze‐on, that is, accretion rates, from radar layer tracking and geodesy are limited in spatial coverage and resolution. Here we develop a new method to estimate accretion rate, and the resulting oxygen input at a lake lid, using airborne radar data over Lake Vostok together with ice‐temperature and chemistry data from the Vostok ice core. Because the lake lid is a coherent reflector of known reflectivity (at our radar frequency), we can infer depth‐averaged radio wave attenuation in the ice, with a spatial resolution of ~1 km along flight lines. Spatial variation in attenuation depends mostly on variation in ice temperature near the lid, which in turn varies strongly with ice mass flux at the lid. We model ice temperature versus depth with ice mass flux as a parameter, thus linking that flux to observed depth‐averaged attenuation. The resulting map of melt and accretion rates independently reproduces features known from earlier studies but now covers the entire lid. We find that freeze‐on is dominant when integrated over the lid, with an ice imbalance of 0.05 to 0.07 cu.km/year, which is robust against uncertainties.

Dale P. Winebrenner↗
NASA NTRS1984

A First Evaluation of LANDSAT TM Data to Monitor Suspended Sediments in Lakes

A comparison was made between ground data collected from Lake Chicot, Arkansas, and Thematic Mapper (TM) data collected on September 23, 1982. A preliminary analysis of limited data indicate tht Thematic Mapper data may be useful in monitoring suspended sediment and chlorophyll in a lake with high suspended sediment loads. Total suspended loads ranged from 168 to 508 mg/l. TM Band 3 appears to be most useful with Bands 1, 2 and 4 also containing useful information relative to suspended sediments. Considering water data only, Bands 1, 2 and 3 appear to provide similar information. Bands 3 and 4 are also significantly related. Bands 5 and 7 appear to have independent information content relative to the presence or absence of water. Insufficient range of water temperature ground truth data made an evaluation of TM Band 6 difficult.

Schiebe, F. R.↗