Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Data Assimilation Technology Transfer from Planetary Exploration to Terrestrial Applications

Data assimilation can be a valuable tool for discovery and exploration. Planetary missions--principally polar orbiting spacecraft--are now capable of returning enough information to constrain global dynamical models. However, such missions operate under a number of severe constraints: there is no ground truth to calibrate and validate either the models or the data: and there are limited computational resources available, particularly onboard the spacecraft, for the near real-time processing that is required for aerobraking and other semi-autonomous maneuvers. A modified data assimilation approach, in which the prime analysis variable is the observed quantity (i.e., infrared radiances), has been found to be effective in deriving global meteorology from Mars Global Surveyor Thermal Emission Spectrometer data. It may also be useful in a number of terrestrial applications (e.g. aerosol assimilation).

Houben, Howard↗

Expansion-history preferences of DESI DR2 and external data

We explore the origin of the preference of Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) baryon acoustic oscillation measurements and external data from cosmic microwave background (CMB) and type Ia supernovae (SNIa) that dark energy behavior departs from that expected in the standard cosmological model with vacuum energy (Λ ⁢CDM). In our analysis, we allow a flexible scaling of the expansion rate with redshift that nevertheless allows reasonably tight constraints on the quantities of interest, and adopt and validate a simple yet accurate compression of the CMB data that allows us to constrain our phenomenological model of the expansion history. We find that data consistently show a preference for a 3%–4% increase in the expansion rate at 𝑧 ≃ 0.7 relative to that predicted by the standard Λ⁢ CDM model, in excellent agreement with results from the less flexible (𝑤 0 ,𝑤 𝑎 ) parametrization which was used in previous analyses. Even though our model allows a departure from the best-fit Λ⁢ CDM model at zero redshift, we find no evidence for such a signal. We also find no evidence (at greater than 1⁢𝜎 significance) for a departure of the expansion rate from the Λ ⁢CDM predictions at higher redshifts for any of the data combinations that we consider. Altogether, our results strengthen the robustness of the findings using the combination of DESI, CMB, and SNIa data to dark-energy modeling assumptions.

Cosmological parameters↗

Exploring and Analyzing Climate Variations Online by Using NASA MERRA-2 Data at GES DISC

NASA Giovanni (Goddard Interactive Online Visualization ANd aNalysis Infrastructure) (http:giovanni.sci.gsfc.nasa.govgiovanni) is a web-based data visualization and analysis system developed by the Goddard Earth Sciences Data and Information Services Center (GES DISC). Current data analysis functions include Lat-Lon map, time series, scatter plot, correlation map, difference, cross-section, vertical profile, and animation etc. The system enables basic statistical analysis and comparisons of multiple variables. This web-based tool facilitates data discovery, exploration and analysis of large amount of global and regional remote sensing and model data sets from a number of NASA data centers. Long term global assimilated atmospheric, land, and ocean data have been integrated into the system that enables quick exploration and analysis of climate data without downloading, preprocessing, and learning data. Example data include climate reanalysis data from NASA Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) which provides data beginning in 1980 to present; land data from NASA Global Land Data Assimilation System (GLDAS), which assimilates data from 1948 to 2012; as well as ocean biological data from NASA Ocean Biogeochemical Model (NOBM), which provides data from 1998 to 2012. This presentation, using surface air temperature, precipitation, ozone, and aerosol, etc. from MERRA-2, demonstrates climate variation analysis with Giovanni at selected regions.

knowledge base↗

Program of solar wind data analysis utilizing data from Pioneer 6, Mariner 5 and explorer 35

A combined data analysis and theoretical program aimed at interpreting and utilizing solar wind data obtained from Pioneer 6, Mariner 5, and Explorer 35 has been completed. A theoretical model of the radial dependence of large scale solar wind inhomogeneities was developed and used to map solar wind variations measured by Explorer 35 to various heliocentric distances and to the orbits of Mercury, Venus, and Mars. The model was also used to determine power spectra velocity, density and temperature variations of 20 R sub s from spectra obtained from the Mariner 5 data at an average heliocentric distance of 180 R sub s. Five stream-stream interaction events in the Pioneer 6 data were analyzed which confirmed the picture of a spiral compression ridge interfacing the two streams and the associated east-west deflections of the solar wind flow. Magnetopause crossings observed in Explorer 35 plasma data were used to develop statics on boundary motions at lunar distance. A study of the geomagnetic disturbance field asymmetry was performed and a model of disturbance field from a partial ring current was developed.

Siscoe, G. L.↗

Ground Processing of Data From the Mars Exploration Rovers

A computer program implements the Earth side of the protocol that governs the transfer of data files generated by the Mars Exploration Rovers. It also provides tools for viewing data in these files and integrating data-product files into automated and manual processes. It reconstitutes files from telemetry data packets. Even if only one packet is received, metadata provide enough information to enable this program to identify and use partial data products. This software can generate commands to acknowledge received files and retransmit missed parts of files, or it can feed a manual process to make decisions about retransmission. The software uses an Extensible Markup Language (XML) data dictionary to provide a generic capability for displaying files of basic types, and uses external "plug-in" application programs to provide more sophisticated displays. This program makes data products available with very low latency, and can trigger automated actions when complete or partial products are received. The software is easy to install and use. The only system requirement for installing the software is a Java J2SE 1.4 platform. Several instances of the software can be executed simultaneously on the same machine.

Wright, Jesse↗

The use of radar and LANDSAT data for mineral and petroleum exploration in the Los Andes region, Venezuela

A geological study of a 27,500 sq km area in the Los Andes region of northwestern Venezuela was performed which employed both X-band radar mosaics and computer processed Landsat images. The 3.12 cm wavelength radar data were collected with horizontal-horizontal polarization and 10 meter spatial resolution by an Aeroservices SAR system at an altitude of 12,000 meters. The radar images increased the number of observable suspected fractures by 27 percent over what could be mapped by LANDSAT alone, owing mostly to the cloud cover penetration capabilities of radar. The approximate eight fold greater spatial resolution of the radar images made possible the identification of shorter, narrower fractures than could be detected with LANDSAT data alone, resulting in the discovery of a low relief anticline that could not be observed in LANDSAT data. Exploration targets for petroleum, copper, and uranium were identified for further geophysical work.

Vincent, R. K.↗

Reconstruction of the interatomic forces from dynamic scanning transmission electron microscopy data

We explore the possibility for reconstruction of the generative physical models describing interactions between atomic units in solids from observational electron microscopy data. In this work, scanning transmission electron microscopy (STEM) is used to observe the dynamic motion of Si atoms at the edge of monolayer graphene under continuous electron beam illumination. The resulting time-lapsed STEM images represent the snapshots of observed chemical states of the system. We use two approaches: potential of mean force calculation using a radial distribution function and a direct fitting of the graphene–Si interatomic pairwise potentials with force matching, to reconstruct the force fields in the materials. These studies lay the foundation for quantitative analysis of materials energetics from STEM data through the sampling of the metastable states in the chemical space of the system.

42 ENGINEERING↗

Performance Debugging and Tuning of Flash-X with Data Analysis Tools

State-of-the-art multiphysics simulations running on large scale leadership computing platforms have many variables contributing to their performance and scaling behavior. We recently encountered an interesting performance anomaly in Flash-X, a multiphysics multicomponent simulation software, when characterizing its performance behavior on several large-scale HPC platforms. The anomaly was tracked down to the interaction between the use of dynamic allocation of scratch data and data locality in the cache hierarchy. In this paper we present the details of unexpected performance variability of Flash-X, its extensive analysis using the performance measurement tool TAU to collect the data and Python data analysis libraries to explore the data, and our insights from this experience. In this process, we discovered and removed or mitigated two additional performance limiting bottlenecks for performance tuning.

Huck, Kevin↗

Science information systems: Visualization

Future programs in earth science, planetary science, and astrophysics will involve complex instruments that produce data at unprecedented rates and volumes. Current methods for data display, exploration, and discovery are inadequate. Visualization technology offers a means for the user to comprehend, explore, and examine complex data sets. The goal of this program is to increase the effectiveness and efficiency of scientists in extracting scientific information from large volumes of instrument data.

Wall, Ray J.↗

AVIRIS as a tool for carbonatite exploration: Comparison of SPAM and Mbandmap data analysis methods

Data acquired with the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) of the Mountain Pass, San Bernadino County, California, area were analyzed to evaluate the use of narrow-band imaging data for carbonatite exploration. Carbonatites are igneous carbonate-rich rocks that are economically important in part because they are the major source for rare-earth minerals. Because the 224 AVIRIS spectral channels have a nominal spectral resolution of 10 nm, narrow absorption features such as those displayed by the rare-earth elements neodymium (Nd) and samarium (Sm) may be detected. The Mountain Pass region encompasses a well-exposed sequence of sedimentary, metamorphic, and igneous rocks, including an alkalic carbonatite intrusion. The carbonatite was emplaced in Precambrian granitic rocks that are fault bounded by a thick suite of Paleozoic, sedimentary rock, predominantly dolomite. The carbonatite stock, the major source of light rare-earth elements (REE) in the United States, affords the opportunity to test AVIRIS capabilities for detecting REE absorption features. Nd-bearing minerals display narrow, sharp and distinctive spectral features at 580, 740, 800, and 870 nm. Minerals bearing Sm display similarly sharp features near 1090, 1250, 1410, and 1550 nm. The more common REE, lanthanum and cerium, do not display absorption features in the visible/near-infrared region in their natural oxidation states.

Kingston, Marguerite J.↗

Squeezing Every Last 'Bit' of Information from Enceladus Mass Spectrometry

Potential opportunities to return to Enceladus in Discovery and Flagship class missions inspire development of next-generation instruments and creative approaches to sample collection, sample analysis, and data analysis and transmission strategies. Mass spectrometers (MS) are ideally suited to future Enceladus missions due to their analytical power in identifying a range of molecular and ionic compositions – including complex organics – and potentially astrobiologically-important features such as isotope ratios, chirality, and enantiomeric excess. However, long communication delays from Enceladus and limited bandwidth limits the data transmission from these higher-data-volume instruments, likely delaying mission-related response to new data. We explore the utility of data science and machine learning (ML) on isotope ratio (IR)MS data collected from laboratory analogs of Enceladus to: 1) process data quickly for rapid ground-based analyses, 2) understand if compositional and biosignature information could be extracted from IRMS data, and 3) evaluate whether onboard ML techniques could improve sample analysis, cadence, and transmission prioritization. Laboratory analogs analyzed isotopes of volatile CO2 that interacted with seawaters of varying composition, and include both abiotic and biotic (microbially-influenced) experiments. Enceladus’s alkaline oceans promote speciation of carbon into multiple forms (e.g., H2CO3 / CO2, HCO3-, and CO32-), each of which could be isotopically fractionated by abiotic or biotic reactions. Large (>2‰) changes in carbon isotopes (δ13C) are observed from some biotic experiments inoculated with complex microbial ecosystems relative to the abiotic seawaters. ML training and classification suggests that microbial samples can be distinguished from abiotic samples, yet that a broad range of microbial experiments are necessary to train ML models to cover a range of complexities including disequilibria, and isotopic and compositional fractionation.

geochemistry↗

The Future of NASA Earth Science in the Commercial Cloud: Challenges and Opportunities

NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).

Alexey N Shiklomanov↗

University Data Management Pilot Utilizing the Nuclear Research Data System

Background In 2022, the Office of Science and Technology Policy (OSTP) issued a memo that significantly reshaped the landscape of access to federally funded research. The memo mandated that all taxpayer-funded research be made available to the public without delay upon publication, without an embargo period, superseding the 2013 OSTP public access policy. This public access policy promotes transparency and the democratization of knowledge, ensuring that the fruits of scientific endeavors funded by federal agencies could be immediately accessed and built upon by scientists, educators, students, and the public at large. To implement the requirements of the OSTP guidance and DOE Public Access Plan, the Office of Nuclear Energy (NE) has implemented public access plan guidance and has identified several areas where better data management practices would further expand public access to important nuclear energy related scientific data, reports, and other technical products. Significant NE supported efforts are already underway for data management and public access to important nuclear energy related data.1 2 To address gaps in data management practices, and improve retention and accessibility of data, NE is actively exploring enhanced data management options utilizing its high-performance computing resources administered by its Nuclear Scientific User Facility Program. A newly piloted system, the Nuclear Research Data System (NRDS) acts as a portal for data collection and dissemination. Nuclear Energy University Program Research and Development Portfolio According to Web of Science, NEUP has produced 2,345 journal publication that have been cited more than 61,000 times3 and countless conference proceedings. These publications are publicly available through OSTI.gov and in the open literature. Additional scientific and technical products including project milestones that are not publications and NEUP project final reports are vetted through OSTI.gov and released once reviewed and approved by DOE. Since 2009, NEUP has awarded close to 1,000 different R&D projects in technical areas across the NE research programs. As of June 2023, 512 NEUP reports are publicly available on OSTI. The underlying data for projects is still held at universities, and data transfer, co-location, and dissemination has not occurred in a systematic way. NEUP data is currently accessible through myriad university-based data repositories, or through direct requests to PIs. The program identified this patchwork of repositories, or often lack of publicly available data, as a significant barrier to an organized, accessible, and comprehensive solution to sharing data with the larger nuclear energy community. Approach The goal of this pilot project is to establish a pathway to a consolidated long-term repository for NEUP project data. To accomplish this goal, the pilot strives to accomplish the following objectives: Establish data collection standards, including a standard set of required supplementary information to contextualize and support raw data files. Work with the HPC group collect and upload information and to modify the NRDS system, as needed, to support a standardized approach. Resolve potential barriers to successful roll out of an expanded data collection strategy, including modifying data management plan guidelines and establishing a document and data release process that accounts for potential intellectual property and/or export control concerns. Results Overall, the pilot was successful in collecting 8,982 raw and processes data files, 220 reports, 56 calibration files, and 5,931 other supplementary documents. Supplementary documents included experimental plans, methods, journal publications and conference proceedings, milestone reports, and final reports. Figure 2 shows the number of data sets and supplementary project information provided by each project. Projects has significantly different input, depending on experimental data produced and completeness of the datasets provided.

Data collection↗

The DECam Local Volume Exploration Survey: Overview and First Data Release

The DECam Local Volume Exploration survey (DELVE) is a 126-night survey program on the 4 m Blanco Telescope at the Cerro Tololo Inter-American Observatory in Chile. DELVE seeks to understand the characteristics of faint satellite galaxies and other resolved stellar substructures over a range of environments in the Local Volume. DELVE will combine new DECam observations with archival DECam data to cover ~15,000 deg 2 of high Galactic latitude (|b| > 10°) southern sky to a 5σ depth of g, r, i, z ~ 23.5 mag. In addition, DELVE will cover a region of ~2200 deg 2 around the Magellanic Clouds to a depth of g, r, i ~ 24.5 mag and an area of ~135 deg 2 around four Magellanic analogs to a depth of g, i ~ 25.5 mag. Here, we present an overview of the DELVE program and progress to date. Furthermore, we also summarize the first DELVE public data release (DELVE DR1), which provides point-source and automatic aperture photometry for ~520 million astronomical sources covering ~5000 deg 2 of the southern sky to a 5σ point-source depth of g = 24.3 mag, r = 23.9 mag, i = 23.3 mag, and z = 22.8 mag. DELVE DR1 is publicly available via the NOIRLab Astro Data Lab science platform.

79 ASTRONOMY AND ASTROPHYSICS↗