Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “information extraction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Earth Science Data Analytics: Preparing for Extracting Knowledge from Information

Data analytics is the process of examining large amounts of data of a variety of types to uncover hidden patterns, unknown correlations and other useful information. Data analytics is a broad term that includes data analysis, as well as an understanding of the cognitive processes an analyst uses to understand problems and explore data in meaningful ways. Analytics also include data extraction, transformation, and reduction, utilizing specific tools, techniques, and methods. Turning to data science, definitions of data science sound very similar to those of data analytics (which leads to a lot of the confusion between the two). But the skills needed for both, co-analyzing large amounts of heterogeneous data, understanding and utilizing relevant tools and techniques, and subject matter expertise, although similar, serve different purposes. Data Analytics takes on a practitioners approach to applying expertise and skills to solve issues and gain subject knowledge. Data Science, is more theoretical (research in itself) in nature, providing strategic actionable insights and new innovative methodologies. Earth Science Data Analytics (ESDA) is the process of examining, preparing, reducing, and analyzing large amounts of spatial (multi-dimensional), temporal, or spectral data using a variety of data types to uncover patterns, correlations and other information, to better understand our Earth. The large variety of datasets (temporal spatial differences, data types, formats, etc.) invite the need for data analytics skills that understand the science domain, and data preparation, reduction, and analysis techniques, from a practitioners point of view. The application of these skills to ESDA is the focus of this presentation. The Earth Science Information Partners (ESIP) Federation Earth Science Data Analytics (ESDA) Cluster was created in recognition of the practical need to facilitate the co-analysis of large amounts of data and information for Earth science. Thus, from a to advance science point of view: On the continuum of ever evolving data management systems, we need to understand and develop ways that allow for the variety of data relationships to be examined, and information to be manipulated, such that knowledge can be enhanced, to facilitate science. Recognizing the importance and potential impacts of the unlimited ways to co-analyze heterogeneous datasets, now and especially in the future, one of the objectives of the ESDA cluster is to facilitate the preparation of individuals to understand and apply needed skills to Earth science data analytics. Pinpointing and communicating the needed skills and expertise is new, and not easy. Information technology is just beginning to provide the tools for advancing the analysis of heterogeneous datasets in a big way, thus, providing opportunity to discover unobvious scientific relationships, previously invisible to the science eye. And it is not easy It takes individuals, or teams of individuals, with just the right combination of skills to understand the data and develop the methods to glean knowledge out of data and information. In addition, whereas definitions of data science and big data are (more or less) available (summarized in Reference 5), Earth science data analytics is virtually ignored in the literature, (barring a few excellent sources).

data analytics↗

Geologic information from satellite images

Extracting geologic information from ERTS and Skylab/EREP images is best done by a geologist trained in photo-interpretation. The information is at a regional scale, and three basic types are available: rock and soil, geologic structures, and landforms. Discrimination between alluvium and sedimentary or crystalline bedrock, and between units in thick sedimentary sequences is best, primarily because of topographic expression and vegetation differences. Discrimination between crystalline rock types is poor. Folds and fractures are the best displayed geologic features. They are recognizable by topographic expression, drainage patterns, and rock or vegetation tonal patterns. Landforms are easily discriminated by their familiar shapes and patterns. Several examples demonstrate the applicability of satellite images to tectonic analysis and petroleum and mineral exploration.

Lee, K.↗

Extracting conformational structure information of benzene molecules via laser-induced electron diffraction

Here, we have measured the angular distributions of high energy photoelectrons of benzene molecules generated by intense infrared femtosecond laser pulses. These electrons arise from the elastic collisions between the benzene ions with the previously tunnel-ionized electrons that have been driven back by the laser field. Theory shows that laser-free elastic differential cross sections (DCSs) can be extracted from these photoelectrons, and the DCS can be used to retrieve the bond lengths of gas-phase molecules similar to the conventional electron diffraction method. From our experimental results, we have obtained the C-C and C-H bond lengths of benzene with a spatial resolution of about 10 pm. Our results demonstrate that laser induced electron diffraction (LIED) experiments can be carried out with the present-day ultrafast intense lasers already. Looking ahead, with aligned or oriented molecules, more complete spatial information of the molecule can be obtained from LIED, and applying LIED to probe photo-excited molecules, a “molecular movie” of the dynamic system may be created with sub-A°ngstrom spatial and few-ten femtosecond temporal resolutions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Extraction of Tumor Site from Cancer Pathology Reports using Deep Filters

Purpose: Pathology reports are the primary source of information concerning the millions of cancer cases across the United States. Cancer registries manually process the pathology reports to extract the pertinent information including primary tumor site, behavior, histology, laterality, and grade. Processing a large volume of the pathology reports in a timely manner is a continuing challenge for cancer registries. The purpose of this study is to develop an information extraction pipeline to reliably and efficiently extract reportable information. Method: We have developed a novel inverse-regression (IR) based information extraction pipeline. The inverse-regression based supervised filter has been successfully applied to many application domains. However, its application to the information extraction from unstructured text is hindered primarily by the extreme high-dimensionality of n-gram representations of text. In this study, we attempt to overcome the obstacles by a novel bootstrapping strategy. First, we use an information-theoretic mutual information based filter to discard the excessive and redundant n-gram features. This step reduces the size and improves the condition number of the sample covariance matrix, thus reducing the computational cost and improving the numerical stability of the subsequent inverse-regression step. Then we use localized sliced inverse-regression (LSIR) to learn a low-dimensional discriminatory subspace for information inference. In particular, we use the k-nearest neighbors of an unlabeled pathology report in the learned representation to infer the desired information from the labeled data in a supervised manner. Results: The experiments were conducted on a set of de-identified pathology reports with human expert labels as the ground truth. Our pipeline consistently performed better than or comparable to the best performing state-of-the-art methods while reducing the training and inference times substantially. Conclusion: Our results demonstrate the potential of inverse-regression based information extraction pipeline for reliable and efficient information extraction from unstructured text. The information extracted from the pathology reports can be used along with clinical information, medical imaging, and genomic information to instigate discoveries in cancer research.

Dubey, Abhishek↗

Knowledge management information tool analytics with distributed database engine - 15737

The D and D KM-IT is a web-based knowledge management information tool custom built for the deactivation and decommissioning (D and D) user community. The system allows interested users to post information which goes through a custom work flow. To better improve the performance and user experience, the analysis of server logs is being conducted using MongoDB. MongoDB is a document database that provides high performance, high availability, and easy scalability. Objectives: - Feasibility study of Distributed Database Engine, MongoDB for web analytics; - Analyze server logs to evaluate D and D KM-IT module usage; - Generate useful information from the analysis. Method: - The server logs were loaded and stored in MongoDB for analysis; - Analysis and visualization was performed using NodeJS and Java Script library. Results: - It was possible to store log files in MongoDB; - Log files with different time stamps and groups from different servers can be aggregated; - Queries can be written to extract meaningful information from aggregated log files (e.g. users from different countries/organizations). Conclusions: - MongoDB is useful for server log analytics as the analyst can immediately access, analyze, and visualize MongoDB data based on the requirements; - The information can be extracted to develop custom reports; - Optimized queries can be run for fast data access. Path forward: - Custom queries need to be developed to extract information leading to improved user information.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Automated Interpretation and Extraction of Topographic Information from Time of Flight Secondary Ion Mass Spectrometry Data

Time of flight secondary ion mass spectrometry (ToF SIMS) is one of the most powerful characterization tools allowing imaging of the chemical properties of various systems and materials. It allows precise studies of the chemical composition with sub-100-nm lateral and nanometer depth spatial resolution. However, comprehensive interpretation of ToF SIMS results is challengeable, because of the data volume and its multidimensionality. Furthermore, investigation of the samples with pronounced topographical features are complicated by the spectral shift. In this work we developed approach for the comprehensive ToF SIMS data interpretation based on the data analytics and automated extraction of the sample topography based on time of flight shift. We further applied this approach to investigate correlation between biological function and chemical composition in Arabidopsis roots.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Disentangling Coexisting Structural Order Through Phase Lock-In Analysis of Atomic-Resolution STEM Data

As a real-space technique, atomic-resolution STEM imaging contains both amplitude and geometric phase information about structural order in materials, with the latter encoding important information about local variations and heterogeneities present in crystalline lattices. Such phase information can be extracted using geometric phase analysis (GPA), a method which has generally focused on spatially mapping elastic strain. Here we demonstrate an alternative phase demodulation technique and its application to reveal complex structural phenomena in correlated quantum materials. As with other methods of image phase analysis, the phase lock-in approach can be implemented to extract detailed information about structural order and disorder, including dislocations and compound defects in crystals. Extending the application of this phase analysis to Fourier components that encode periodic modulations of the crystalline lattice, such as superlattice or secondary frequency peaks, we extract the behavior of multiple distinct order parameters within the same image, yielding insights into not only the crystalline heterogeneity but also subtle emergent order parameters such as antipolar displacements. When applied to atomic-resolution images spanning large (~0.5 × 0.5 μm 2 ) fields of view, this approach enables vivid visualizations of the spatial interplay between various structural orders in novel materials.

74 ATOMIC AND MOLECULAR PHYSICS↗

Extracting halo independent information from dark matter electron scattering data

Direct detection experiments and the interpretation of their results are sensitive to the velocity structure of the dark matter in our galactic halo. Here we extend the formalism that deals with such astrophysics-driven uncertainties, originally introduced in the context of dark-matter-nuclear scattering, to include dark-matter-electron scattering interactions. Using mock data, we demonstrate that the ability to determine the correct dark matter mass and velocity distribution is depleted for recoil spectra which only populate a few low-lying bins, such as models involving a light mediator. We also demonstrate how this formalism allows one to test the compatibility of existing experimental data sets (e.g. SENSEI and EDELWEISS), as well as make predictions for possible future experiments (e.g. GaAs-based detectors).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Extracting land use information from the earth resources technology satellite data by conventional interpretation methods

A procedure for obtaining land use data from satellite imagery by the use of conventional interpretation methods is presented. The satellite is described briefly, and the advantages of various scales and multispectral scanner bands are discussed. Methods for obtaining satellite imagery and the sources of this imagery are given. Equipment used in the study is described, and samples of land use maps derived from satellite imagery are included together with the land use classification system used. Accuracy percentages are cited and are compared to those of a previous experiment using small scale aerial photography.

Vegas, P. L.↗

Extracting ocean surface information from altimeter returns - The deconvolution method

An evaluation of the deconvolution method for estimating ocean surface parameters from ocean altimeter waveforms is presented. It is shown that this method presents a fast, accurate way of determining the ocean surface parameters from noisy altimeter data. Three parameters may be estimated by using this method, including the altimeter-height error, the ocean-surface standard deviation, and the ocean-surface skewness. By means of a Monte Carlo experiment, an 'optimum' deconvolution algorithm and the accuracies with which the above parameters may be estimated using this algorithm are determined. Then the influence of instrument effects, such as errors in calibration and pointing-angle estimation, on the estimated parameters is examined. Finally, the deconvolution algorithm is used to estimate height and ocean-surface parameters from Seasat data.

Rodriguez, Ernesto↗

Parallel Visualization Co-Processing of Overnight CFD Propulsion Applications

An interactive visualization system pV3 is being developed for the investigation of advanced computational methodologies employing visualization and parallel processing for the extraction of information contained in large-scale transient engineering simulations. Visual techniques for extracting information from the data in terms of cutting planes, iso-surfaces, particle tracing and vector fields are included in this system. This paper discusses improvements to the pV3 system developed under NASA's Affordable High Performance Computing project.

Edwards, David E.↗

Classification of the Gabon SAR Mosaic Using a Wavelet Based Rule Classifier

A method is developed for semi-automated classification of SAR images of the tropical forest. Information is extracted using the wavelet transform (WT). The transform allows for extraction of structural information in the image as a function of scale. In order to classify the SAR image, a Desicion Tree Classifier is used. The method of pruning is used to optimize classification rate versus tree size. The results give explicit insight on the type of information useful for a given class.

Simard, Marc↗

Extracting Space Weather Information from Research Models: Opportunities and Challenges

In addition to supporting space research in the international community, the Community Coordinated Modeling Center (CCMC) has as its second objective to apply the power of modern research models toward space weather specification and forecasting. Motivated by the objectives to test models and to ease the transition of research models to space weather forecasting organizations, the CCMC has developed a number of real-time modeling systems, as well as a large number of modeling and data products for space weather forecasting support. Over time, these activities have produced tailored products for partners, as well as tools, which address the space weather needs of NASA's robotic mission community. All tools are accessible via a configurable, flexible interface. During this process, CCMC has accumulated substantial experience in understanding model performance, as well as in the design and execution of realtime systems. This presentation will focus on lessons learned and it will suggest low hanging fruit for transition to operations at partner agencies.

Hesse, Michael↗

Data Assimilation to Extract Soil Moisture Information From SMAP Observations

Statistical techniques permit the retrieval of soil moisture estimates in a model climatology while retaining the spatial and temporal signatures of the satellite observations. As a consequence, they can be used to reduce the need for localized bias correction techniques typically implemented in data assimilation (DA) systems that tend to remove some of the independent information provided by satellite observations. Here, we use a statistical neural network (NN) algorithm to retrieve SMAP (Soil Moisture Active Passive) surface soil moisture estimates in the climatology of the NASA Catchment land surface model. Assimilating these estimates without additional bias correction is found to significantly reduce the model error and increase the temporal correlation against SMAP CalVal in situ observations over the contiguous United States. A comparison with assimilation experiments using traditional bias correction techniques shows that the NN approach better retains the independent information provided by the SMAP observations and thus leads to larger model skill improvements during the assimilation. A comparison with the SMAP Level 4 product shows that the NN approach is able to provide comparable skill improvements and thus represents a viable assimilation approach.

Method for extracting long-equivalent wavelength interferometric information

A process for extracting long-equivalent wavelength interferometric information from a two-wavelength polychromatic or achromatic interferometer. The process comprises the steps of simultaneously recording a non-linear sum of two different frequency visible light interferograms on a high resolution film and then placing the developed film in an optical train for Fourier transformation, low pass spatial filtering and inverse transformation of the film image to produce low spatial frequency fringes corresponding to a long-equivalent wavelength interferogram. The recorded non-linear sum irradiance derived from the two-wavelength interferometer is obtained by controlling the exposure so that the average interferogram irradiance is set at either the noise level threshold or the saturation level threshold of the film.

Hochberg, Eric B.↗