Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “text analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

NOUS: A Knowledge Graph Management System

Knowledge graphs represent information as entities and relationships between them. For tasks such as natural language question answering or automated analysis of text, a knowledge graph provides valuable context to establish the specific type of entities being discussed. It allow us to derive better context about newly arriving information and leads to intelligent reasoning capabilities. We address two primary needs: A) Automated construction of knowledge graphs is a technically challenging, expensive process; and B) The ability to synthesize new information by monitoring newly emerging knowledge is a transformational capability that does not exist in state of the art systems.

Source record↗

Python HITMIX

SAND2024-10158O Python HITMIX is a software package for computing hitting time moments of vertices in a graph. Hitting time moments can be used to rank the strengths of relationships between vertices in a graph. Examples are provided for computing and using hitting time moments on generic graphs and similarity graphs arising from the analysis of text documents in information retrieval applications. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Dunlavy, Daniel↗

Information Theoretic Measures for Visual Analytics: The Silver Ticket?

In the context of text-based analysis workflows, we propose that an effective analytic tool facilitates triage by a) enabling users to identify and set aside irrelevant content (i.e., reduce the complexity of information in a dataset) and b) develop a working mental model of which items are most relevant to the question at hand. This LDRD funded research developed a dataset that is enabling this team to evaluate propose normalized compression distance (NCD) as a task, user, and context-insensitive measure of categorization outcomes (Shannon entropy is reduced as order is imposed). Effective analytics tools help people impose order, reducing complexity in measurable ways. Our concept and research was documented in a paper accepted to the ACM conference "Beyond Time and Error: Novel Methods in Information Visualization Evaluation", part of the IEEE VisWeek Conference, Baltimore, MD, October 16-21, 2016. The paper is included as an appendix to this report.

97 MATHEMATICS AND COMPUTING↗

Morphing Terminology Study

This study investigates methods of automatically identifying and characterizing significant transitions in term usage over time. Within scientific literature, the occurrence of terms reflects the use of technologies and techniques as well as the study of specific species and materials. Transitions in terminology usage may be a result of vocabulary standardization or specialization in which terms are replaced with their shorter form. They may also be a result of new applications, combinations, alternatives, or interests that result in the appearance of new or existing terminology in unexpected contexts.

99 GENERAL AND MISCELLANEOUS↗

Online Interactive Platform for COVID-19 Literature Visual Analytics: Platform Development Study

Background Papers on COVID-19 are being published at a high rate and concern many different topics. Innovative tools are needed to aid researchers to find patterns in this vast amount of literature to identify subsets of interest in an automated fashion. Objective We present a new online software resource with a friendly user interface that allows users to query and interact with visual representations of relationships between publications. Methods We publicly released an application called PLATIPUS (Publication Literature Analysis and Text Interaction Platform for User Studies) that allows researchers to interact with literature supplied by COVIDScholar via a visual analytics platform. This tool contains standard filtering capabilities based on authors, journals, high-level categories, and various research-specific details via natural language processing and dozens of customizable visualizations that dynamically update from a researcher’s query. Results PLATIPUS is available online and currently links to over 100,000 publications and is still growing. This application has the potential to transform how COVID-19 researchers use public literature to enable their research. Conclusions The PLATIPUS application provides the end user with a variety of ways to search, filter, and visualize over 100,00 COVID-19 publications.</:p>

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Pollution in the Press: Employing Text Analytics to Understand Regional Water Quality Narratives

Drinking water has and will continue to be at the foundation of our nation’s well-being and there is a growing interest in United States (US) drinking water quality. Nearly 30% of the United States population obtained their water from community water systems that did not meet federal regulations in 2019. Given the heavy interactions between society and drinking water quality, this study integrates social constructionism, environmental injustice, and sociohydrological systems to evaluate local awareness of drinking water quality issues. By employing text analytics, we explore potential drivers of regional water quality narratives within 25 local news sources across the United States. Specifically, we assess the relationship between printed local newspapers and water quality violations in communities as well as the influence of social, political, and economic factors on the coverage of drinking water quality issues. Results suggest that the volume and/or frequency of local drinking water violations is not directly reflected in local news coverage. Additionally, news coverage varied across sociodemographic features, with a negative relationship between Hispanic populations and news coverage of Lead and Copper Rule, and a positive relationship among non-Hispanic white populations. These findings extend current understanding of variations in local narratives to consider nuances of water quality issues and indicate opportunities for increasing equity in environmental risk communication.

54 ENVIRONMENTAL SCIENCES↗

NOUS: A Knowledge Graph Management System

Knowledge graphs represent information as entities and relationships between them. For tasks such as natural language question answering or automated analysis of text, a knowledge graph provides valuable context to establish the specific type of entities being discussed. It allow us to derive better context about newly arriving information and leads to intelligent reasoning capabilities. We address two primary needs: A) Automated construction of knowledge graphs is a technically challenging, expensive process; and B) The ability to synthesize new information by monitoring newly emerging knowledge is a transformational capability that does not exist in state of the art systems.

Source record↗

Automatic Keyword Extraction from Individual Documents

This paper introduces a novel and domain-independent method for automatically extracting keywords, as sequences of one or more words, from individual documents. We describe the method’s configuration parameters and algorithm, and present an evaluation on a benchmark corpus of technical abstracts. We also present a method for generating lists of stop words for specific corpora and domains, and evaluate its ability to improve keyword extraction on the benchmark corpus. Finally, we apply our method of automatic keyword extraction to a corpus of news articles and define metrics for characterizing the exclusivity, essentiality, and generality of extracted keywords within a corpus.

99 GENERAL AND MISCELLANEOUS↗

Cybersecurity Training Curriculum Analysis through the application of Machine Learning Text Classification and Natural Language Processing

In the domain of cybersecurity, there are a wide variety of education and training courses offered by a variety of training providers (commercial vendors, governmental, and academic institutions). Unfortunately, a comprehensive cross-provider mapping of the body of course offerings does not currently exist. Furthermore, although individual providers have made efforts, an accepted cross-provider mapping of education and training courses (or categories) to an accepted framework of work-roles by cybersecurity work-role and competency level has not yet been developed. The inability to compare training courses by topic or cybersecurity work-role and the level of difficulty (competency level) affects all organizations in identifying and selecting potential training opportunities for their personnel performing cybersecurity duties. In this work, we report on our application of Machine Learning (ML) Text Classification and Natural Language Processing (NLP) methodologies to begin to create a process to organize an accurate and thorough catalog of course offerings by work-role and competency level. Through the analysis of text-based course attributes (description, learning objectives, prerequisites, etc.) along with the text-based attributes for identified cybersecurity work-roles, our ML efforts examined methods to determine the work-role "best-fit" for each course as well as the competency level through action-verb text comparison.

99 GENERAL AND MISCELLANEOUS↗

Measurement of the production cross section for a W boson in association with a charm quark in proton–proton collisions at $\sqrt{s} = 13\,\hbox {TeV}$

The strange quark content of the proton is probed through the measurement of the production cross section for a W boson and a charm (c) quark in proton–proton collisions at a center-of-mass energy of 13$\,\text {Te}\hspace{-.08em}\text {V}$. The analysis uses a data sample corresponding to a total integrated luminosity of 138$\,\text {fb}^{-1}$ collected with the CMS detector at the LHC. The W bosons are identified through their leptonic decays to an electron or a muon, and a neutrino. Charm jets are tagged using the presence of a muon or a secondary vertex inside the jet. The $\hbox {W}+\hbox {c}$ production cross section and the cross section ratio $R_\textrm{c}^{\pm }= \sigma ({\hbox {W}}^{+}+\bar{\text {c}})/\sigma (\hbox {W}^{-}+{\textrm{c}})$ are measured inclusively and differentially as functions of the transverse momentum and the pseudorapidity of the lepton originating from the W boson decay. The precision of the measurements is improved with respect to previous studies, reaching 1% in $R_\textrm{c}^{\pm }= 0.950 \pm 0.005\,\text {(stat)} \pm 0.010 \,\text {(syst)} $. The measurements are compared with theoretical predictions up to next-to-next-to-leading order in perturbative quantum chromodynamics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Mining for Surprise Events within Text Streams

This paper summarizes algorithms and analysis methodology for mining the evolving content in text streams. Text streams include news, press releases from organizations, speeches, Internet blogs, etc. These data are a fundamental source for detecting and characterizing strategic intent of individuals and organizations as well as for detecting abrupt or surprising events within communities. Specifically, an analyst may need to know if and when the topic within a text stream changes. Much of the current text feature methodology is focused on understanding and analyzing a single static collection of text documents. Corresponding analytic activities include summarizing the contents of the collection, grouping the documents based on similarity of content, and calculating concise summaries of the resulting groups. The approach reported here focuses on taking advantage of the temporal characteristics in a text stream to identify relevant features (such as change in content), and also on the analysis and algorithmic methodology to communicate these characteristics to a user. We present a variety of algorithms for detecting essential features within a text stream. A critical finding is that the characteristics used to identify features in a text stream are uncorrelated with the characteristics used to identify features in a static document collection. Our approach for communicating the information back to the user is to identify feature (word/phrase) groups. These resulting algorithms form the basis of developing software tools for a user to analyze and understand the content of text streams. We present analysis using both news information and abstracts from technical articles, and show how these algorithms provide understanding of the contents of these text streams.

99 GENERAL AND MISCELLANEOUS↗

Search for Anomalous Trilinear Couplings of Electroweak Gauge Bosons Using Angular Variables at $\sqrt{s}$ = 13 TeV at CMS

A study of techniques for improving limits placed on anomalous trilinear couplings of electroweak gauge bosons is presented. Electroweak gauge bosons couple to one another as well as to fermions. Deviations of these couplings from their standard model values would be a sign of new physics. Parameters that affect the couplings of the gauge bosons to each other also affect their helicity, which in turn may be measured from their decay products. Angles between the decay planes of the gauge bosons, as well as between their decay products, are measured. The analysis uses $35.9\,\text{fb}^{-1}$ of proton-proton collision data from the LHC taken with the CMS detector. Building on a prior analysis that measured the fiducial cross section of $pp \to WW/WZ \to \ell\nu jj$, we show that angular variables can improve limits on anomalous couplings even further.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Large-Scale Trajectory Analysis via Feature Vectors

The explosion of both sensors and GPS-enabled devices has resulted in position/time data being the next big frontier for data analytics. However, many of the problems associated with large numbers of trajectories do not necessarily have an analog with many of the historic big-data applications such as text and image analysis. Modern trajectory analytics exploits much of the cutting-edge research in machine-learning, statistics, computational geometry and other disciplines. We will show that for doing trajectory analytics at scale, it is necessary to fundamentally change the way the information is represented through a feature-vector approach. We then demonstrate the ability to solve large trajectory analytics problems using this representation.

58 GEOSCIENCES↗

Demystifying the Resilience of Large Language Models: An End-to-End Perspective

Deep neural networks are known to be resilient to random bit-wise faults in their parameters. However, this resilience has primarily been established through evaluations of classification models. The extent to which this claim holds for large-language models remains underexplored. In this work, we conduct an extensive measurement study on the impact of random bitwise faults in commercial-scale language models. We perform an in-depth analysis of the resulting generation outputs. We first expose that these language models are not truly resilient to random bit-flips. While aggregate metrics such as accuracy may suggest resilience, an in-depth inspection of the generated outputs shows significant degradation in text quality. Our analysis also shows that tasks requiring more complex reasoning suffer more from performance and quality degradation. Moreover, we extend our analysis to models with augmented reasoning capabilities, such as Chain-of-Thought or Mixture of Experts architectures, and characterize their failure scenarios under random bit-flips.

Sun, Yu↗

MULTI-CORE AND OPTICAL PROCESSOR RELATED APPLICATIONS RESEARCH AT OAK RIDGE NATIONAL LABORATORY

High-speed parallelization of common tasks holds great promise as a low-risk approach to achieving the significant increases in signal processing and computational performance required for next generation innovations in reconfigurable radio systems. Researchers at the Oak Ridge National Laboratory have been working on exploiting the parallelization offered by this emerging technology and applying it to a variety of problems. This paper will highlight recent experience with four different parallel processors applied to signal processing tasks that are directly relevant to signal processing required for SDR/CR waveforms. The first is the EnLight Optical Core Processor applied to matched filter (MF) correlation processing via fast Fourier transform (FFT) of broadband Dopplersensitive waveforms (DSW) using active sonar arrays for target tracking. The second is the IBM CELL Broadband Engine applied to 2-D discrete Fourier transform (DFT) kernel for image processing and frequency domain processing. And the third is the NVIDIA graphical processor applied to document feature clustering. EnLight Optical Core Processor. Optical processing is inherently capable of high-parallelism that can be translated to very high performance, low power dissipation computing. The EnLight 256 is a small form factor signal processing chip (5x5 cm2) with a digital optical core that is being developed by an Israeli startup company. As part of its evaluation of foreign technology, ORNL's Center for Engineering Science Advanced Research (CESAR) had access to a precursor EnLight 64 Alpha hardware for a preliminary assessment of capabilities in terms of large Fourier transforms for matched filter banks and on applications related to Doppler-sensitive waveforms. This processor is optimized for array operations, which it performs in fixed-point arithmetic at the rate of 16 TeraOPS at 8-bit precision. This is approximately 1000 times faster than the fastest DSP available today. The optical core performs the matrix-vector multiplications, where the nominal matrix size is 256x256. The system clock is 125MHz. At each clock cycle, 128K multiply-and-add operations per second (OPS) are carried out, which yields a peak performance of 16 TeraOPS. IBM Cell Broadband Engine. The Cell processor is the extraordinary resulting product of 5 years of sustained, intensive R&D collaboration (involving over $400M investment) between IBM, Sony, and Toshiba. Its architecture comprises one multithreaded 64-bit PowerPC processor element (PPE) with VMX capabilities and two levels of globally coherent cache, and 8 synergistic processor elements (SPEs). Each SPE consists of a processor (SPU) designed for streaming workloads, local memory, and a globally coherent direct memory access (DMA) engine. Computations are performed in 128-bit wide single instruction multiple data streams (SIMD). An integrated high-bandwidth element interconnect bus (EIB) connects the nine processors and their ports to external memory and to system I/O. The Applied Software Engineering Research (ASER) Group at the ORNL is applying the Cell to a variety of text and image analysis applications. Research on Cell-equipped PlayStation3 (PS3) consoles has led to the development of a correlation-based image recognition engine that enables a single PS3 to process images at more than 10X the speed of state-of-the-art single-core processors. NVIDIA Graphics Processing Units. The ASER group is also employing the latest NVIDIA graphical processing units (GPUs) to accelerate clustering of thousands of text documents using recently developed clustering algorithms such as document flocking and affinity propagation.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Superconducting Tunneling Spectroscopy of Spin-Orbit Coupling and Orbital Depairing in Nb : SrTiO 3

We have examined here the intrinsic spin-orbit coupling and orbital depairing in thin films of Nb-doped ${\mathrm{SrTiO}}_{3}$ by superconducting tunneling spectroscopy. The orbital depairing is geometrically suppressed in the two-dimensional limit, enabling a quantitative evaluation of the Fermi level spin-orbit scattering using Maki's theory. The response of the superconducting gap under in-plane magnetic fields demonstrates short spin-orbit scattering times ${{\tau}}_{\mathrm{so}}{\le}1.1\text{ }\text{ }\mathrm{ps}$. Analysis of the orbital depairing indicates that the heavy electron band contributes significantly to pairing. These results suggest that the intrinsic spin-orbit scattering time in ${\mathrm{SrTiO}}_{3}$ is comparable to those associated with Rashba effects in ${\mathrm{SrTiO}}_{3}$ interfacial conducting layers and can be considered significant in all forms of superconductivity in ${\mathrm{SrTiO}}_{3}$.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Workbench Analysis Sequence Processor

The Workbench Analysis Sequence Processor (WASP) was developed to streamline lexing, parsing, access, validation, and analysis of ascii text files.

Lefebvre, RobertA.↗

Normal modes in thermal AdS via the Selberg zeta function

The heat kernel and quasinormal mode methods of computing 1-loop partition functions of spin s s fields on hyperbolic quotient spacetimes \mathbb{H}^{3}/\mathbb{Z} ℍ 3 / ℤ are related via the Selberg zeta function. We extend that analysis to thermal \text{AdS}_{2n+1} AdS 2 n + 1 backgrounds, with quotient structure \mathbb{H}^{2n+1}/\mathbb{Z} ℍ 2 n + 1 / ℤ . Specifically, we demonstrate the zeros of the Selberg function encode the normal mode frequencies of spin fields upon removal of non-square-integrable modes. With this information we construct the 1-loop partition functions for symmetric transverse traceless tensors in terms of the Selberg zeta function and find exact agreement with the heat kernel method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗