Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Pattern recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions.

Blanson, Nina↗

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions

Blanson, Nina↗

Real-time optical multiple object recognition and tracking system and method

System for optically recognizing and tracking a plurality of objects within a field of vision. Laser (46) produces a coherent beam (48). Beam splitter (24) splits the beam into object (26) and reference (28) beams. Beam expanders (50) and collimators (52) transform the beams (26, 28) into coherent collimated light beams (26', 28'). A two-dimensional SLM (54), disposed in the object beam (26'), modulates the object beam with optical information as a function of signals from a first camera (16) which develops X and Y signals reflecting the contents of its field of vision. A hololens (38), positioned in the object beam (26') subsequent to the modulator (54), focuses the object beam at a plurality of focal points (42). A planar transparency-forming film (32), disposed with the focal points on an exposable surface, forms a multiple position interference filter (62) upon exposure of the surface and development processing of the film (32). A reflector (53) directing the reference beam (28') onto the film (32), exposes the surface, with images focused by the hololens (38), to form interference patterns on the surface. There is apparatus (16', 64) for sensing and indicating light passage through respective ones of the positions of the filter (62), whereby recognition of objects corresponding to respective ones of the positions of the filter (62) is affected. For tracking, apparatus (64) focuses light passing through the filter (62) onto a matrix of CCD's in a second camera (16') to form a two-dimensional display of the recognized objects.

Chao, Tien-Hsin↗

Investigation of environmental change pattern in Japan. Investigation of the ecological environment index from observation of the regional vegetation cover and their growing condition

The author has identified the following significant results. Practical use of recognition results of LANDSAT data as the base map of the field survey or the retouching work of vegetation and land use has the effective benefit to cut down the cost, labor, and time lower than 10% of a conventional method. Correct and detailed vegetation maps were prepared using combined interpretation of repetition of data of different seasons at warm and temperate forested areas.

Maruyasu, T.↗

Heterothermic Migration Strategies in Flying Vertebrates

Migration is a widespread and highly variable trait among animals. Population-level patterns arise from individual-level decisions, including physiological and energetic constraints. Many aspects of migration are influenced by behaviors and strategies employed during periods of stopover, where migrants may encounter variable or unpredictable conditions. Thermoregulation can be a major cost for homeotherms which largely encounter ambient temperatures below the lower critical temperature during migration, especially during the rest phase of the daily cycle. In this review we describe the empirical evidence, theoretical models, and potential implications of bats and birds that use heterothermy to reduce thermoregulatory costs during migration. Torpor-assisted migration is a strategy described for migrating temperate insectivorous bats, whereby torpor can be used during periods of inactivity to drastically reduce thermoregulatory costs and increase net refueling rate, leading to shorter stopover duration, reduced fuel load requirement, and potential consequences for broad-scale movement patterns and survival. Hummingbirds can adopt a similar strategy, but most birds are not capable of torpor. However, there is an increasing recognition of the use of more shallow heterothermic strategies by diverse bird species during migration, with similarly important implications for migration energetics. A growing body of published literature and preliminary data from ongoing research indicate that heterothermic migration strategies in birds may be more common than traditionally appreciated. We further take a broad evolutionary perspective to consider heterothermy as an alternative to migration in some species, or as a conceptual link to consider alternatives to seasonal resource limitations. There is a growing body of evidence related to heterothermic migration strategies in bats and birds, but many important questions related to the broader implications of this strategy remain.

bats↗

Megafans as Hydrous Environments

The mesoscale sedimentary environment known as the megafan, is a low-angle, partial cone of fluvial sediment generated where a river enters an unconfined basin where it begins the process of avulsing over wide areas. In shifting to different positions, the river lays down a partial cone of sediment and establishes a characteristic radial pattern of paleo courses. The apparent paucity of sedimentary bodies obviously tied to martian outflow channels may also relate to the difficulty of recognition due to their sheer size and featurelessness. However, the existence of megafans on Mars is being examined now that their ubiquity and characteristics on Earth are better understood. Accordingly we suggest two likely candidates on Mars: Maja Valles fluvial cone and Amazonis Planitia fluvial sedimentary bodies. Two cryptic examples from Amazonis Planitia may be important for understanding subsurface hydrous accumulation. For at least some of its history, discharges from Mangala Valles likely resulted in megafans. Distances from the end of Mangala Valles to the northern (low) margin of the planitia are very large, a fact that has suggested that fluvial emplacement was unlikely. However, the megafan model shows that long megafan radii are indeed feasible. It has been suggested further that discharge from Labou Vallis (8.5S 154.5W) must have led to fluvial sedimentation in the planitia. We suggest that during locally non-lacustrine/ocean phases, this sedimentation would have occurred in the form of megafans. However, the megafan model shows that long megafan radii are indeed feasible. It has been suggested further that discharge from Labou Vallis (8.5S 154.5W) must have led to fluvial sedimentation in the planitia. We suggest that during locally non-lacustrine/ocean phases, this sedimentation would have occurred in the form of megafans. Megafans emanating from Marte, Mangala and Labou valles have probably contributed to hydrous near-subsurface environments--in their distal reaches, i.e. along the northern, eastern and southeastern margins of Amazonis Planitia at various times. Following a new terrestrial analog, we conclude groundwater has at times accumulated preferentially beneath distal slopes of the Maja Valles feature, and along the northern, eastern and southeastern margins of Amazonis Planitia.

Wilkinson, M. Justin↗

Recognition of beach and nearshore depositional features of Chesapeake Bay

Beach and nearshore depositional features are being mapped with the objectives of determining a quick-look analysis of littoral drift and sedimentation patterns in areas of little or no data. Evaluation of beach and nearshore features aid in the selection of small boat harbors, shoreline protective structures, and general coastal zone development. Through ERTS-1 aircraft support imagery, beach depositional features mapped are cuspate forelands, welded beach ridges, and recurved spits. The nearshore depositional features exhibit a bar and trough topography with three distinct types of sedimentary structures; longshore, transverse, and reticulated bars. Synoptic coverage of beach and nearshore depositional features by ERTS-1 data help in determining the general sedimentation patterns, growth of the beach features and stability of the bar and trough topography.

Kerhin, R. T.↗

Sub-Audible Speech Recognition Based upon Electromyographic Signals

Method and system for processing and identifying a sub-audible signal formed by a source of sub-audible sounds. Sequences of samples of sub-audible sound patterns ("SASPs") for known words/phrases in a selected database are received for overlapping time intervals, and Signal Processing Transforms ("SPTs") are formed for each sample, as part of a matrix of entry values. The matrix is decomposed into contiguous, non-overlapping two-dimensional cells of entries, and neural net analysis is applied to estimate reference sets of weight coefficients that provide sums with optimal matches to reference sets of values. The reference sets of weight coefficients are used to determine a correspondence between a new (unknown) word/phrase and a word/phrase in the database.

Jorgensen, Charles C.↗

Forecast of Wildfire Potential Across California USA Using a Transformer

Wildfires are a major issue facing the United States, a matter further exacerbated by an ever-changing climate. In California alone, wildfires are responsible for billions of dollars in damages and take lives each year. Accurately predicting fire danger conditions allows preparation awareness before wildfires start. Transformers are a class of deep learning models designed to identify patterns in sequential datasets. In recent years, transformers have gained popularity through their impressive performance in natural language processing and other applications of signal recognition. This analysis demonstrates the ability of a transformer with a residual connection to forecast fire danger potential over the state of California. Wildland fire potential index (WFPI) maps collected from the US Geological Survey database from January 1st 2020 to December 31st 2023 were used to tune, train and evaluate the transformer. Meteorological inputs (provided by Daymet daily weather and climatological summaries), the normalized difference vegetation index (NDVI) (calculated from the Moderate Resolution Imaging Spectroradiometer (MODIS)), and outputs from the Scott and Burgman fire behavior fuel models (to characterize maps of fuel types), were used as inputs. Our results show that a transformer can effectively emulate the US Forest Service modeled WFPI maps of California USA for four week long forecasts over the month of July, 2023, with correlations ranging from 0.85 – 0.98.

Limber, Russell [ORNL]↗

Sparse distributed memory

Sparse distributed memory was proposed be Pentti Kanerva as a realizable architecture that could store large patterns and retrieve them based on partial matches with patterns representing current sensory inputs. This memory exhibits behaviors, both in theory and in experiment, that resemble those previously unapproached by machines - e.g., rapid recognition of faces or odors, discovery of new connections between seemingly unrelated ideas, continuation of a sequence of events when given a cue from the middle, knowing that one doesn't know, or getting stuck with an answer on the tip of one's tongue. These behaviors are now within reach of machines that can be incorporated into the computing systems of robots capable of seeing, talking, and manipulating. Kanerva's theory is a break with the Western rationalistic tradition, allowing a new interpretation of learning and cognition that respects biology and the mysteries of individual human beings.

Denning, Peter J.↗

GraphAide: Advanced Graph-Assisted Query and Reasoning System

Curating knowledge from multiple siloed sources that contain both structured and unstructured data is a major challenge in many real-world applications. Pattern matching and querying represent fundamental tasks in modern data analytics that leverage this curated knowledge. The development of such applications necessitates overcoming several research challenges, including data extraction, named entity recognition, data modeling, and designing query interfaces. Moreover, the explainability of these functionalities is critical for their broader adoption. The emergence of Large Language Models (LLMs) has accelerated the development lifecycle of new capabilities. Nonetheless, there is an ongoing need for domain-specific tools tailored to user activities. The creation of digital assistants has gained considerable traction in recent years, with LLMs offering a promising avenue to develop such assistants utilizing domain-specific knowledge and assumptions. In this context, we introduce an advanced query and reasoning system, GraphAide, which constructs a knowledge graph (KG) from diverse sources and allows to query and reason over the resulting KG. GraphAide harnesses both the KG and LLMs to rapidly develop domain-specific digital assistants. It integrates design patterns from retrieval augmented generation (RAG) and the semantic web to create an agentic LLM application. GraphAide underscores the potential for streamlined and efficient development of specialized digital assistants, thereby enhancing their applicability across various domains.

Purohit, Sumit [BATTELLE (PACIFIC NW LAB)] (ORCID:↗

A Survey of Logic Formalisms to Support Mishap Analysis

Mishap investigations provide important information about adverse events and near miss incidents. They are intended to help avoid any recurrence of previous failures. Over time, they can also yield statistical information about incident frequencies that helps to detect patterns of failure and can validate risk assessments. However, the increasing complexity of many safety critical systems is posing new challenges for mishap analysis. Similarly, the recognition that many failures have complex, systemic causes has helped to widen the scope of many mishap investigations. These two factors have combined to pose new challenges for the analysis of adverse events. A new generation of formal and semi-formal techniques have been proposed to help investigators address these problems. We introduce the term mishap logics to collectively describe these notations that might be applied to support the analysis of mishaps. The proponents of these notations have argued that they can be used to formally prove that certain events created the necessary and sufficient causes for a mishap to occur. These proofs can be used to reduce the bias that is often perceived to effect the interpretation of adverse events. Others have argued that one cannot use logic formalisms to prove causes in the same way that one might prove propositions or theorems. Such mechanisms cannot accurately capture the wealth of inductive, deductive and statistical forms of inference that investigators must use in their analysis of adverse events. This paper provides an overview of these mishap logics. It also identifies several additional classes of logic that might also be used to support mishap analysis.

Johnson, Chris↗

Repurposing Drilling Control Diagnostics for Subsurface Edge Detection and Boundary Advisement During Planetary Drilling

Informed decision-making during lunar drilling and sampling missions will require data monitoring tools and specialized ground data systems. Accurate and updated situational awareness, with ongoing data monitoring, is critical for timely responses by to incoming science data. Traverse plans and scheduled activities may need to be flexibly changed in order to react to unexpected data or situations. Unlike (for example) Mars missions, the relative lightspeed closeness of the Moon allows for near-real-time ground processing of incoming mission and instrument data. An Apollo-class lunar regolith drill will in a sense “travel” a meter or two vertically at a given subsurface characterization site. As the drill penetrates into lunar regolith, it is likely to encounter a range of material densities, orientations, fracture toughness, and (perhaps) ice percentages. Lunar drill telemetry can provide science teams with a valuable first look into the subsurface structure, the regolith bulk properties, and constituents at each drilled site. Real-time AI-based recognition and reaction to downhole situations has been developed for automated deeper drilling on Mars and beyond. We can leverage the same knowledge bases and pattern-matching as areal-time interpreter of the subsurface, a situational awareness tool during drilling operations. We recently (Sept. 2019) demonstrated this AI drilling monitoring and analysis capability, in control of in-situ drilling and sampling operations, mounted on a KREX-2 rover in Chile’s Atacama Desert. Terrestrial automated drilling log analyses in oil exploration have used similar machine learning techniques in classifying and identifying features in drilling logs –but these typically are designed assuming a drilling fluid influencing downhole measurements and data (permeability, resistivity). Drilling models and existing AI software designed to detect and respond to drilling faults and hard materials can be repurposed, for near-real-time (ground-based) interpretation of drilling telemetry –a potentially valuable advisory tool for strata boundaries and changes in drilling parameters. On the Moon, this approach could be used to study the structure and to some extent the composition of lunar regolith vs. borehole depth, based on recognizable variations in fracture hardness, drilling energy and penetration rates while actively drilling. Since the early 2000s, a series of increasingly-capable real-time drilling telemetry interpretation and characterization software tools have been developed. These subsurface models and software tools have monitored the real-time drilling data received, and automatically identified changes in drill behavior (e.g., encountering a harder target layer, bit inclusions, drill choking due to infall downhole, and others) correlating these with subsurface structures and features. We discuss the mappings between drill borehole parameters, faults or events detected, and modeled changes in rock layer boundaries, in examples drawn from field testing at analog sites in an Arctic impact crater, Rio Tinto, and Chile’s Atacama Desert. These demonstrate how subsurface structural boundaries led to fault detections and responses by the software.

drilling advisor↗

Impact of the 1997-1998 El-Nino of Regional Hydrology

The 1997-1998 El-Nino brought with it a range of severe local-regional hydrological phenomena. Record high temperatures and extremely dry soil conditions in Texas is an example of this regional effect. The El-Nino and La-Nina change the continental weather patterns considerably. However, connections between continental weather anomalies and regional or local anomalies have not been established to a high degree of confidence. There are several unique features of the recent El-Nino and La-Nina. Due to the recognition of the present El-Nino well in advance, there have been several coupled model studies on global and regional scales. Secondly, there is a near real-time monitoring of the situation using data from satellite sensors, namely, SeaWIFS, TOVS, AVHRR and GOES. Both observations and modeling characterize the large scale features of this El-Nino fairly well. However the connection to the local and regional hydrological phenomenon still needs to be made. This paper will use satellite observations and analysis data to establish a relation between local hydrology and large scale weather patterns. This will be the first step in using satellite data to perform regional hydrological simulations of surface temperature and soil moisture.

Lakshmi, Venkataraman↗

Recognition of glycoside hydrolase 12 proteins by the immune receptor RXEG1 confers Fusarium head blight resistance in wheat

Summary Fusarium head blight (FHB), caused by Fusarium graminearum , is a devastating disease in wheat ( Triticum aestivum ) that results in substantial yield losses and mycotoxin contamination. Reliable genetic resources for FHB resistance in wheat are lacking. In this study, we characterized glycoside hydrolase 12 (GH12) family proteins secreted by F. graminearum . We established that two GH12 proteins, Fg05851 and Fg11037, have functionally redundant roles in F. graminearum colonization of wheat. Furthermore, we determined that the GH12 proteins Fg05851 and Fg11037 are recognized by the leucine‐rich‐repeat receptor‐like protein RXEG1 in the dicot Nicotiana benthamiana . Heterologous expression of RXEG1 conferred wheat responsiveness to Fg05851 and Fg11037, enhanced wheat resistance to F. graminearum and reduced levels of the mycotoxin deoxynivalenol in wheat grains in an Fg05851/Fg11037‐dependent manner. In the RXEG1 transgenic lines, genes related to pattern‐triggered plant immunity, salicylic acid, jasmonic acid, and anti‐oxidative homeostasis signalling pathways were upregulated during F. graminearum infection. However, the expression of these genes was not significantly changed during infection by the deletion mutant ΔFg05851/Fg11037 , suggesting that the recognition of Fg05851/Fg11037 by RXEG1 triggered plant resistance against FHB. Moreover, introducing RXEG1 into three other different wheat cultivars via crossing also conferred resistance to F. graminearum . Expression of RXEG1 did not have obvious deleterious effects on plant growth and development in wheat. Our study reveals that N. benthamiana RXEG1 remains effective when transferred into wheat, a monocot, which in turn suggests that engineering wheat with interfamily plant immune receptor transgenes is a viable strategy for increasing resistance to FHB.

Wang, Zongkuan↗

State Identification for Planetary Rovers: Learning and Recognition

A planetary rover must be able to identify states where it should stop or change its plan. With limited and infrequent communication from ground, the rover must recognize states accurately. However, the sensor data is inherently noisy, so identifying the temporal patterns of data that correspond to interesting or important states becomes a complex problem. In this paper, we present an approach to state identification using second-order Hidden Markov Models. Models are trained automatically on a set of labeled training data; the rover uses those models to identify its state from the observed data. The approach is demonstrated on data from a planetary rover platform.

Aycard, Olivier↗