Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “source discovery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

ML-driven Strong Lens Discoveries: Down to θ E ~ $0^{_{''}}_{^.}03$ and M halo < 10 11 M ⊙

We present results on extending the strong lens discovery space down to much smaller Einstein radii ( θ E ≲ $0^{_{''}}_{^.}03$) and much lower halo mass (M halo < 10 11 M ⊙ ) through the combination of JWST observations and machine learning (ML) techniques. First, we forecast detectable strong lenses with JWST using CosmoDC2 as the lens catalog, and a source catalog down to 29th magnitude. By further incorporating the VELA hydrodynamical simulations of high-redshift galaxies, we simulate strong lenses. We train a ResNet on these images, achieving near-100% completeness and purity for “conventional” strong lenses ( θ E ≳ $0^{_{''}}_{^.}05$), applicable to JWST, the Hubble Space Telescope (HST), the Roman Space Telescope, and Euclid VIS. For the first time, we also search for very low halo mass strong lenses (M halo < 10 11 M ⊙ ) in simulations, with θ E << $0^{_{''}}_{^.}05$, down to the best resolution ($0^{_{''}}_{^.}03$) and depth (10,000 s) limits of JWST using ResNet. A U-Net model is employed to pinpoint these small lenses in images, which are otherwise virtually impossible for human detection. Our results indicate that JWST can find ∼17/deg 2 such low-halo-mass lenses, with the locations of ∼1.1/deg 2 of these detectable by the U-Net at ∼100% precision (and ∼7.0/deg 2 at a 99.0% precision). To validate our model for finding “conventional” strong lenses, we apply it to HST images, discovering two new strong lens candidates previously missed by human classifiers in a crowdsourcing project (E. O. Garvin et al. 2022). This study demonstrates the (potentially “superhuman”) advantages of ML combined with current and future space telescopes for detecting conventional, and especially, low-halo-mass strong lenses, which are critical for testing cold dark matter models.

Silver, Ethan [Harvard University, Cambridge, MA (↗
NASA NTRS1995

Shells in the C2 coma of Comet P/Halley

We reanalyzed the CN images of Comet P/Halley, in which jets have been discovered for the first time, in search of shell structures. Shells were actually detected at the outer edges of the frames on those dates for which shells with radii small enough to be covered by the limited field of view of the CCD were predicted. The C2 images of the same data set were subjected to an analogous investigation which led to the discovery of shell structures in C2 as well. The morphology of the CN and the C2 shells is essentially equal on the same observational date. They have the same radii and show almost identical asymmetries which suggests that CN and C2 in the shells originate from the same general source. The comparison of the jets in both species before and after a two-dimensional continuum subtraction supports this supposition. The similar morphology of the jets indicates that both species are produced from the same bulk of precursor material which has been ejected in the form of jets from the same active area. However, similarly located and oriented jets in CN and C2 do not show similar relative intensities in most cases. These differences in the intensity distribution imply that the production rates of CN and C2 follow different laws.

Schulz, Rita↗
NASA NTRS2006

Nitrile/Buna N Material Failure Assessment for an O-Ring used on the Gaseous Hydrogen Flow Control Valve (FCV) of the Space Shuttle Main Engine

After the rollout of Space Shuttle Discovery in April 2005 in preparation for return-to-flight, there was a failure of the Orbiter (OV-103) helium signature leak test in the gaseous hydrogen (GH2) system. Leakage was attributed to the Flow Control Valve (FCV) in Main Engine 3. The FCV determined to be the source of the leak for OV-103 is designated as LV-58. The nitrile/Buna N rubber O-ring seal was removed from LV-58, and failure analysis indicated radial cracks providing leak paths in one quadrant. Cracks were eventually found in 6 of 9 FCV O-rings among the three Shuttle Orbiters, though none were as severe as those for LV-58, OV-103. Testing by EM10 at MSFC on all 9 FCV O- rings included: laser dimensional, Shore A hardness and properties from a dynamic mechanical analyzer (DMA) and an Instron tensile machine. The following test data was obtained on the cracked quadrant of the LV-58, OV-103 O-ring: (1) the estimated compression set was only 9.5%, compared to none for the rest of the O-ring; (2) Shore A hardness for the O.D. was higher by almost 4 durometer points than for the rest of the O-ring; and (3) DMA data showed that the storage/elastic modulus E was almost 25% lower than for the rest of the O-ring. Of the 8 FCV O-rings tested on an Instron, 4 yielded tensile strengths that were below the MIL spec requirement of 1350 psi-a likely influence of rubber cracking. Comparisons were made between values of modulus determined by DNA (elastic) and Instron (Young s). Each nitrile/Buna N O-ring used in the FCV conforms to the MIL-P-25732C specification. A number of such O-rings taken from shelf storage at MSFC and Kennedy Space Center (KSC) were used to generate a reference curve of DMA glass transition temperature (Tg) vs. shelf storage time ranging from 8 to 26 years. A similar reference curve of TGA onset temperature (of rubber weight loss) vs. shelf storage time was also generated. The DMA and TGA data for the used FCV O-rings were compared to the reference curves. Correlations were also made between the DMA modulus (at 22 C) and Shore A hardness for all 9 of the FCV O-rings used among the three Shuttle Orbiters. The radial cracking in the FCV O-rings was determined to be due to ozone attack, as nitrile/Buna N rubber is susceptible to such attack. Nitrile/Buna N material under MIL-P25732C should be used in a hydraulic fluid environment to help protect it from cracking. However, the FCV O-rings were used in an air only environment. The FCV design has as much as a 9-mil gap that allows the O.D. of the O-ring to be directly exposed to ozone, pressurized air and some elevated temperatures, accelerating the weathering process that leads to O-ring cracking. Space Shuttle flights will likely not continue past 2010. Therefore, Shuttle management decided to continue using the nitrile/Buna N material for the FCVs, but have each O-ring replaced after 3 years to minimize any chances for crack initiation.

Wingard, Doug↗
NASA NTRS2010

The Origin of Dust in High-z Galaxies

The discovery of massive amounts of dust in the high-redshift galaxy Jl148+5251, when the universe was merely'" 900 Myr old, presents a unique opportunity for studying the role of massive stars in the formation and destruction of dust grains, and the potential role of AGB as dust sources as well. In this talk I will review the different models for the presence of dust and the origin of the infrared emission in these galaxies.

Dwek, Eli↗
DOE OSTI2015

Long-Sought Discovery Fills in Missing Details of Cell ‘Switchboard’

A biomedical breakthrough, published today in the journal Nature, reveals never-before-seen details of the human body’s cellular switchboard that regulates sensory and hormonal responses. The work is based on an X-ray laser experiment at the Department of Energy’s SLAC National Accelerator Laboratory. The much-anticipated discovery, a decade in the making, could have broad impacts on development of more highly targeted and effective drugs with fewer side effects to treat conditions including high blood pressure, diabetes, depression and even some types of cancer. The ultrabright X-rays of SLAC's Linac Coherent Light Source (LCLS) enabled the research team to complete the first 3-D atomic-scale map of a key signaling protein called arrestin while it was docked with a cell receptor involved in vision. The receptor is a well-studied example from a family of hundreds of G protein-coupled receptors, or GPCRs, which are targeted by about 40 percent of drugs on the market. Its structure while coupled with arrestin provides new insight into the on/off signaling pathways of GPCRs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

bnl/pub-Maffettone_2020_08

The application of the XCA package as first demonstrated in aXiv:2008.00283. ABSTRACT: The discovery of new structural and functional materials is driven by phase identification, often using X-ray diffraction (XRD). Automation has accelerated the rate of XRD measurements, greatly outpacing XRD analysis techniques that remain manual, time consuming, error prone, and impossible to scale. With the advent of autonomous robotic scientists or self-driving labs, contemporary techniques prohibit the integration of XRD. Here, we describe a computer program for the autonomous characterization of XRD data, driven by artificial intelligence (AI), for the discovery of new materials. Starting from structural databases, we train an ensemble model using a physically accurate synthetic dataset, which output probabilistic classifications --- rather than absolutes --- to overcome the overconfidence in traditional neural networks. This AI agent behaves as a companion to the researcher, improving accuracy and offering unprecedented time savings, and is demonstrated on a diverse set of organic and inorganic materials challenges. This innovation is directly applicable to inverse design approaches, robotic discovery systems, and can be immediately considered for other forms of characterization such as spectroscopy and the pair distribution function.

Maffettone, PhillipM [Brookhaven National Lab. (BN↗
DOE OSTI2015

DISCOVERY OF GAMMA-RAY PULSATIONS FROM THE TRANSITIONAL REDBACK PSR J1227-4853

The 1.69 ms spin period of PSR J1227−4853 was recently discovered in radio observations of the low-mass X-ray binary XSS J12270−4859 following the announcement of a possible transition to a rotation-powered millisecond pulsar state, inferred from decreases in optical, X-ray, and gamma-ray flux from the source. We report the detection of significant (5σ) gamma-ray pulsations after the transition, at the known spin period, using ∼1 year of data from the Large Area Telescope (LAT) on board the Fermi Gamma-ray Space Telescope. The gamma-ray light curve of PSR J1227−4853 can be fit by one broad peak, which occurs at nearly the same phase as the main peak in the 1.4 GHz radio profile. The partial alignment of light-curve peaks in different wavebands suggests that at least some of the radio emission may originate at high altitude in the pulsar magnetosphere, in extended regions co-located with the gamma-ray emission site. We folded the LAT data at the orbital period, both pre- and post-transition, but find no evidence for significant modulation of the gamma-ray flux. Analysis of the gamma-ray flux over the mission suggests an approximate transition time of 2012 November 30. Continued study of the pulsed emission and monitoring of PSR J1227−4853, and other known redback systems, for subsequent flux changes will increase our knowledge of the pulsar emission mechanism and transitioning systems.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1983

Discovery of a massive unseen star in LMC X-3

Spectroscopic observations of the optical counterpart of LMC X-3 show it to be a spectroscopic binary in the Large Magellanic Cloud with an orbital period of 1.70 days. The B3 main-sequence primary has a large radial velocity amplitude indicating a mass function of 2.3 solar masses. LMC X-3 is an extremely luminous and variable X-ray source, but no 1.7 day X-ray periodicity has been detected. The lack of optical and X-ray eclipses limits the inclination to less than 70 degrees and implies a mass for the unseen star of more than 9.0 solar masses, if the B star has a normal mass. The system now appears to be the strongest evidence for the existence of a stellar mass black hole and is the first extragalactic example.

Remillard, R.↗
NASA NTRS2011

An Ontology Driven Information Architecture for Interoperable Disparate Data Sources

The mission of the Planetary Data System is to facilitate achievement of NASA's planetary science goals by efficiently collecting, archiving, and making accessible digital data produced by or relevant to NASA's planetary missions, research programs, and data analysis programs. The vision is: (1) To gather and preserve the data obtained from exploration of the Solar System by the U.S. and other nations (2) To facilitate new and exciting discoveries by providing access to and ensuring usability of those data to the worldwide community (3) To inspire the public through availability and distribution of the body of knowledge reflected in the PDS data collection PDS is a federation of heterogeneous nodes including science and support nodes

planetary data systems↗
DOE OSTI2023

PipeSight: A High-Performance Computing Platform for Pipeline Integrity Management

The Phase I feasibility study completed as part of this project has led to a number of innovative technologies being developed and has laid the foundation for a successful Phase II effort to commercialize a platform for managing the integrity of pipelines for the damage mechanisms of the new, hybrid-energy based economy. To ground the development efforts and direction of the project, an extensive market research and customer discovery effort was undertaken early in Phase I. Through this effort, a number of pipeline owners and operators were interviewed, and the following key findings were discovered about the pipeline industry: • Small pipeline operators do not have the central engineering groups necessary to perform their own independent analysis of inspection data, but instead rely on summarized tally sheets provided to them by inspection service providers. • The time it takes to go from an inspection to a completed engineering assessment, even for small segments of pipeline, can take anywhere from 30-120 days. During this delay, critical threats can (and have been known to) cause failures. • Uncertainty is often not accounted for in the assessment of pipeline integrity. The tally sheets provided by third-party service providers are almost always deterministic in nature, identifying threats that present a concern only to the current (not the future) integrity of the pipeline. • It is uncommon to apply the latest technologies to perform advanced assessments of damaged pipelines. There is a desire to use more advanced analysis capabilities to assess threats. Many pipeline operators indicated that they would often excavate a pipeline to perform an inspection and find that the damage was not as bad as they anticipated, thus using limited resources unnecessarily. Companies are not consistent in their use of inspection data to determine corrosion rates, and those that do only calculate deterministic corrosion rates. • The industry has prominently relied on time-based inspections but has recently started to transition to risk-based inspections. However, there appears to be no uniform guidance on how to do so while properly accounting for all sources of uncertainty. • Companies are not storing inspection data in a manner that allows for the ready determination of temporal trends. • Predictive maintenance principles and practices are beginning to be used by early adopters • Some pipelines are being re-purposed to transport different process fluids than they were designed for, e.g., H 2 and CO 2 rich process streams to serve the new hybrid-energy based economy, which are presenting new integrity concerns for the existing pipeline network that crisscrosses the United States. As a result of these discoveries, we were able to target the development efforts in Phase I to best serve the needs of the industry. In Phase I, we developed a way to correlate multiple large-scale scans of the pipeline to determine a probabilistic corrosion rate that accounts for all sources of error and uncertainty in the inspection process. This probabilistic corrosion rate can be used to predict the future thickness distribution of the pipe wall. We demonstrate how this analysis may be performed in an analytical fashion and has been implemented in such a manner that it can be readily distributed using GPU computing through integration of the Kokkos programming model. We also make a very novel extension of the analytical corrosion rate model to Bayesian Networks (an explainable AI technique) that can account for non-parametric distributions of corrosion rates. With the predictions made above for the probabilistic corrosion rate and corresponding future distribution of the pipe wall thickness, we can assess the integrity of the pipeline through the use of a probabilistic engineering assessment. We developed a novel screening data analysis approach that can rapidly identify ‘hotspots’ (local thin areas) where the integrity of the pipeline is a concern. Once more, we implemented this screening approach in C++ to leverage GPU computing via the Kokkos programming model. After the critical hotspots are identified, we developed a program that can automatically generate an advanced finite element model of the damaged regions. Since the number of damaged regions that require advanced analysis can number in the thousands, we integrated an open-source container-native workflow engine for orchestrating parallel jobs on the cloud. Initially, these advanced numerical models were only designed to account for loading due to internal pressure. However, in a slight pivot from the initial Phase I proposal, we developed a complete pipe stress analysis program (called Simflex) which can simulate the complete pipeline and its response to thermal expansion, pressure, thermal bowing, weight, wind, earthquake, support displacement, support friction and external forces. This pipe stress analysis program was written generically, to handle any piping system, but contains the features needed to model long pipelines (i.e., it incorporates a model for soil mechanics and can account for the nonlinear boundary conditions necessary to simulate long underground pipelines). This pipe stress analysis program can simulate any segment of the pipeline (simple or complex) under any set of conditions and loads, to determine the supplemental loads (axial forces and bending moments) at the location of damage. This enables the most accurate state of stress to be accounted for in the pipeline, which can prove critical when evaluating the integrity of a damaged region. In the process of developing the technologies to perform the integrity assessment of the pipeline, we also extended one of the industry standard approaches for performing the assessment of local thin areas that extend more in the circumferential direction than the longitudinal direction of the pipeline. This approach was presented to the API 579-1/AS ME FFS-1 steering committee in November 2021 for consideration in the next edition of the industry standard for Fitness-For-Service (expected to be released in 2023). To help pipeline operators make decisions with the results on any integrity assessment, we developed a new approach to the life-cycle management of pipelines which uses a Bayesian Decision Network. The network is designed to help pipeline operators plan and prioritize inspection activities and ultimately make smarter, more cost-effective decisions. The Bayesian approach accounts for all sources of uncertainty and carries them through to the final optimal decisions, providing a probabilistic framework for optimizing inspection intervals. The proof-of-concept networks developed in the feasibility study are complete, verified, and are focused on a subset of the pipeline. To expand this novel approach to the scale necessary for an entire network of pipelines in Phase II, we will leverage the DOE-funded Bengi solver for industrial-scale decision making with Bayesian Networks [22]. Once implemented, we will be able to provide the pipeline industry with a much-needed tool for optimal inspection planning using truly explainable artificial intelligence (XAI). To handle all of these advanced capabilities into a cloud-based platform, the architecture of the Equity Engineering Cloud (EEC) was extended to include Argo Workflows, a framework capable of distributing and managing a massive number of jobs that consume their own resources, such that thousands of serial finite element simulations can be run in parallel. As part of this substantial undertaking, we also integrated Argo Continuous Delivery (CD) into the EEC, to aid with the rapid prototyping and iterations that will be imperative to the success of the PipeSight platform’s Agile development process in Phase II. As part of the pipe stress analysis program, we also developed a custom visualizer that leverages the DOE-funded VTK visualization library. We added custom contouring capabilities and a means for interacting visually with both the inputs and outputs of the pipe stress analysis program. We also developed routines for automating the post-processing of the finite element simulations to determine if any failure criteria are met and to visualize the deformations, stresses and strains in ParaView using the exodus II file format (a subset of netCDF).

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Observation of Antiferroelectric Domain Walls in a Uniaxial Hyperferroelectric

Abstract Ferroelectric domain walls are a rich source of emergent electronic properties and unusual polar order. Recent studies show that the configuration of ferroelectric walls can go well beyond the conventional Ising‐type structure. Néel‐, Bloch‐, and vortex‐like polar patterns have been observed, displaying strong similarities with the spin textures at magnetic domain walls. Here, the discovery of antiferroelectric domain walls in the uniaxial ferroelectric Pb 5 Ge 3 O 11 is reported. Highly mobile domain walls with an alternating displacement of Pb atoms are resolved, resulting in a cyclic 180° flip of dipole direction within the wall. Density functional theory calculations show that Pb 5 Ge 3 O 11 is hyperferroelectric, allowing the system to overcome the depolarization fields that usually suppress the antiparallel ordering of dipoles along the longitudinal direction. Interestingly, the antiferroelectric walls observed under the electron beam are energetically more costly than basic head‐to‐head or tail‐to‐tail walls. The results suggest a new type of excited domain‐wall state, expanding previous studies on ferroelectric domain walls into the realm of antiferroic phenomena.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Advanced Functional Materials ZnO@ZIF-8 Heterostructures for Neuromorphic Synaptic Devices

Metal-Organic Frameworks have shown great promise for memristive synaptic devices because of their adaptable electrical properties and inherent porosity, which help in efficient ion transport and storage of functional molecules. However, the limited conductivity and sensitivity to moisture associated with most MOF materials hinder their use in electronic applications. In this study, MOFs derived from metabolites have been synthesized, using ZnO as a self-sacrificial metallic source to grow Zeolitic Imidazolate Framework-8 (ZIF-8), forming ZnO@ZIF-8 heteronanostructures for neuromorphic applications. These hybrids ZnO@ZIF-8 act as promising candidates for advanced electronic applications. Through systematic investigations, including a comparison of ZnO@ZIF-8 bilayer devices with ZnO single-layer counterparts, a significant discovery emerged. The bilayer synaptic devices outperformed their single layer counterparts in electrical characteristics, as evidenced by Current-Voltage curve analysis and Long-Term Potentiation/Long Term Depression (LTP/LTD) measurements. Additionally, the ZnO layer thickness (10, 30, 50 nm) has been emphasized and the effects of annealing at 300°C in a vacuum were carefully studied for Neuromorphic Synaptic Devices. Remarkably, the 10 nm ZnO layer exhibited the lowest set voltage and a consistent On/Off ratio. This work marks a significant advancement in understanding bilayer synaptic devices, highlighting the crucial role of ZIF-8 in shaping the future of neuromorphic systems

Kolleboyina, Jayaramulu↗
DOE OSTI2022

Electronic Structure-Based Descriptors for Oxide Properties and Functions

The transition from fossil fuels to renewable energy requires the development of efficient and cost-effective energy storage technologies. A promising way forward is to harness the energy of intermittent renewable sources, such as solar and wind, to perform (electro)catalytic reactions to generate fuels, thus storing energy in the form of chemical bonds. Furthermore, current catalysts rely on the use of expensive, rare, or geographically localized elements, such as platinum. Widespread adoption of new (electro)catalytic technologies hinges on the discovery and development of materials containing earth-abundant elements, which can efficiently catalyze an array of (electro)chemical reactions.

Adsorption↗
DOE OSTI2012

A CANDIDATE ACTIVE GALACTIC NUCLEUS WITH A PURE SOFT THERMAL X-RAY SPECTRUM

We report the discovery of a candidate active galactic nucleus (AGN), 2XMM J123103.2+110648 at z = 0.13, with an X-ray spectrum represented purely by soft thermal emission reminiscent of Galactic black hole (BH) binaries in the disk-dominated state. This object was found in the second XMM-Newton serendipitous source catalog as a highly variable X-ray source. In three separate observations, its X-ray spectrum can be represented either by a multicolor disk blackbody model with an inner temperature of kT{sub in} Almost-Equal-To 0.16-0.21 keV or a Wien spectrum Comptonized by an optically thick plasma with kT Almost-Equal-To 0.14-0.18 keV. The soft X-ray luminosity in the 0.5-2 keV band is estimated to be (1.6-3.8) Multiplication-Sign 10{sup 42} erg s{sup -1}. Hard emission above {approx}2 keV is not detected. The ratio of the soft to hard emission is the strongest among AGNs observed thus far. Spectra selected in high/low-flux time intervals are examined in order to study spectral variability. In the second observation with the highest signal-to-noise ratio, the low-energy (below 0.7 keV) spectral regime flattens when the flux is high, while the shape of the high-energy part (1-1.7 keV) remains unchanged. This behavior is qualitatively consistent with being caused by strong Comptonization. Both the strong soft excess and spectral change consistent with Comptonization in the X-ray spectrum imply that the Eddington ratio is large, which requires a small BH mass (smaller than {approx}10{sup 5} M{sub Sun }).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

The most luminous z ∼ 9-10 galaxy candidates yet found: The luminosity function, cosmic star-formation rate, and the first mass density estimate at 500 Myr

We present the discovery of four surprisingly bright (H {sub 160} ∼ 26-27 mag AB) galaxy candidates at z ∼ 9-10 in the complete HST CANDELS WFC3/IR GOODS-N imaging data, doubling the number of z ∼ 10 galaxy candidates that are known, just ∼500 Myr after the big bang. Two similarly bright sources are also detected in a reanalysis of the GOODS-S data set. Three of the four galaxies in GOODS-N are significantly detected at 4.5σ-6.2σ in the very deep Spitzer/IRAC 4.5 μm data, as is one of the GOODS-S candidates. Furthermore, the brightest of our candidates (at z = 10.2 ± 0.4) is robustly detected also at 3.6 μm (6.9σ), revealing a flat UV spectral energy distribution with a slope β = –2.0 ± 0.2, consistent with demonstrated trends with luminosity at high redshift. Thorough testing and use of grism data excludes known low-redshift contamination at high significance, including single emission-line sources, but as-yet unknown low redshift sources could provide an alternative solution given the surprising luminosity of these candidates. Finding such bright galaxies at z ∼ 9-10 suggests that the luminosity function for luminous galaxies might evolve in a complex way at z > 8. The cosmic star formation rate density still shows, however, an order-of-magnitude increase from z ∼ 10 to z ∼ 8 since the dominant contribution comes from low-luminosity sources. Based on the IRAC detections, we derive galaxy stellar masses at z ∼ 10, finding that these luminous objects are typically 10{sup 9} M {sub ☉}. This allows for a first estimate of the cosmic stellar mass density at z ∼ 10 resulting in log{sub 10} ρ{sub ∗}=4.7{sub −0.8}{sup +0.5} M {sub ☉} Mpc{sup –3} for galaxies brighter than M {sub UV} ∼ –18. The remarkable brightness, and hence luminosity, of these z ∼ 9-10 candidates will enable deep spectroscopy to determine their redshift and nature, and highlights the opportunity for the James Webb Space Telescope to map the buildup of galaxies at redshifts much earlier than z ∼ 10.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2014

Flexible and Scalable Data Fusion using Proactive Schemaless Information Services

Exascale data environments are fast approaching, driven by diverse structured and unstructured data such as system and application telemetry streams, open-source information capture, and on-demand simulation output. Storage costs having plummeted, the question is now one of converting vast stores of data to actionable information. Complicating this problem are the low degrees of awareness across domain boundaries about what potentially useful data may exist, and write-once- read-never issues (data generation/collection rates outpacing data analysis and integration rates). Increasingly, technologists and researchers need to correlate previously unrelated data sources and artifacts to produce fused data views for domain-specific purposes. New tools and approaches for creating such views from vast amounts of data are vitally important to maintaining research and operational momentum. We propose to research and develop tools and services to assist in the creation, refinement, discovery and reuse of fused data views over large, diverse collections of heterogeneously structured data. We innovate in the following ways. First, we enable and encourage end-users to introduce customized index methods selected for local benefit rather than for global interaction (flexible multi-indexing). We envision rich combinations of such views on application data: views that span backing stores with different semantics, that introduce analytic methods of indexing, and that define multiple views on individual data items. We specifically decline to build a big fused database of everything providing a centralized index over all data, or to export a rigid schema to all comers as in federated query approaches. Second, we proactively advertise these application-specific views so that they may be programmatically reused and extended (data proactivity). Through this mechanism, both changes in state (new data in existing view collected) and changes in structure (new or derived view exists) are made known. Lastly, we embrace found data heterogeneity by coupling multi-indexing to backing stores with appropriate semantics (as opposed to a single store or schema).

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2014

Flexible and Scalable Data Fusion using Proactive, Schemaless Information Services

Exascale data environments are fast approaching, driven by diverse structured and unstructured data such as system and application telemetry streams, open-source information capture, and on-demand simulation output. Storage costs having plummeted, the question is now one of converting vast stores of data to actionable information. Complicating this problem are the low degrees of awareness across domain boundaries about what potentially useful data may exist, and write-once-read- never issues (data generation/collection rates outpacing data analysis and integration rates). Increasingly, technologists and researchers need to correlate previously unrelated data sources and artifacts to produce fused data views for domain-specific purposes. New tools and approaches for creating such views from vast amounts of data are vitally important to maintaining research and operational momentum. We propose to research and develop tools and services to assist in the creation, refinement, discovery and reuse of fused data views over large, diverse collections of heterogeneously structured data. We innovate in the following ways. First, we enable and encourage end-users to introduce customized index methods selected for local benefit rather than for global interaction (flexible multi-indexing). We envision rich combinations of such views on application data: views that span backing stores with different semantics, that introduce analytic methods of indexing, and that define multiple views on individual data items. We specifically decline to build a big fused database of everything providing a centralized index over all data, or to export a rigid schema to all comers as in federated query approaches. Second, we proactively advertise these application-specific views so that they may be programmatically reused and extended (data proactivity). Through this mechanism, both changes in state (new data in existing view collected) and changes in structure (new or derived view exists) are made known. Lastly, we embrace found data heterogeneity by coupling multi-indexing to backing stores with appropriate semantics (as opposed to a single store or schema).

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
NASA NTRS1973

Application of ERTS-1 imagery in the fields of geology, agriculture, forestry, and hydrology to selected test sites in Iran

The preliminary study of the ERTS-1 imagery coverage of Iran, commenced on October 26, 1972. All of the images were carefully examined, and a photomosaic covering approximately ninety-five per cent of the country was prepared. A number of images of selected areas were studied in detail. In the field of geology, a number of large scale faults were identified, which do not figure on geological maps. Furthermore, a preliminary study was carried out on the recent sediments, their possible sources, and origin. A limited number of geological work maps were prepared as well. In the fields of agriculture and forestry, studies based on color composite prints of certain areas were undertaken, with a purpose of identifying potential arable areas. Investigations in the field of water resources resulted in the discovery of a number of small lakes, and streams. Furthermore, fluctuations of the water level in some lakes were observed.

Ebtehadj, K.↗