Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Context Aware”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Strategies for the Design and Operation of Resilient Extraterrestrial Habitats

An Earth-independent permanent extraterrestrial habitat system must function as intended under continuous disruptive conditions, and with significantly limited Earth support and extended uncrewed periods. Designing for the demands that extreme environments such as wild temperature fluctuations, galactic cosmic rays, destructive dust, meteoroid impacts (direct or indirect), vibrations, and solar particle events, will place on long-term deep space habitats represents one of the greatest challenges in this endeavor. This context necessitates that we establish the know-how and technologies to build habitat systems that are resilient. Resilience is not simply robustness or redundancy: it is a system property that accounts for both anticipated and unanticipated disruptions via the design choices and maintenance processes and adapts to them in operation. We currently lack the frameworks and technologies needed to achieve a high level of resilience in a habitat system. The Resilient ExtraTerrestrial Habitats Institute (RETHi) has the mission of leveraging existing novel technologies to provide situational awareness and autonomy to enable the design of habitats that are able to adapt, absorb and rapidly recover from expected and unexpected disruptions. We are establishing both fully virtual and coupled physical-virtual simulation capabilities that will enable us to explore a wide range of potential deep space SmartHab configurations and operating modes.

Space habitats↗

Human-Autonomy Teaming Assistant to Support Small Uncrewed Aircraft Systems for Wildland Firefighting Operations

An exploratory human-in-the-loop simulation was conducted to investigate and characterize a Human-Autonomy Teaming (HAT) Assistant to support a remote operator of multiple small Uncrewed Aircraft Systems (sUAS) using a ground control station (GCS) in the context of a wildland fire surveillance mission. Operator performance using the GCS with the HAT Assistant (Assisted Mode) was compared to operator performance using the GCS without the HAT Assistant (Unassisted Mode) during two types of contingency-event scenarios (Low and High Complexity). In the Assisted Mode, the HAT Assistant provided updates to the level of risk to the mission along with recommendations for risk mitigation, which were not provided in the Unassisted Mode. No significant differences in objective performance and subjective ratings of workload, situation awareness, and trust in automation between the Assisted and Unassisted Modes were detected, however there were indications that participants preferred the Assisted GCS over the Unassisted GCS and directions for further development were explored. Additional work is necessary to further refine the HAT Assistant and better characterize its effects on remote operator performance while managing multiple sUAS assets. Future work is recommended to optimize the implementation of an assistant to support operator performance during different missions and across vehicle classes

Human-Autonomy Teaming↗

CAMFeND: Credibility-Aware Multimodal Fake News Detection with Rotational Attention

In the evolving digital landscape, fake news is a significant challenge, influencing public perception and decision-making. Traditional detection approaches focus on single-modal data or simple multimodal fusion, often overlooking deeper interactions and news credibility. We propose a novel model addressing these limitations by introducing rotational attention and news domain information as a feature. Unlike static attention mechanisms, our rotational attention dynamically shifts query, key, and value roles across text and image inputs, enabling richer cross-modal interaction. Incorporating news domain information further enhances the model’s reliability by associating news posts with top domains extracted from Google search results, reducing false detections. This approach assesses both the content and the broader web context in which the news is discussed. Our model outperforms existing state-of-the-art methods by providing deeper, layered multimodal integration and domain information analysis, resulting in a more robust and adaptive fake news detection system.

Gupta, Nidhi↗

Enhanced Training for Cyber Situational Awareness in Red versus Blue Team Exercises

This report summarizes research conducted through the Sandia National Laboratories Enhanced Training for Cyber Situational Awareness in Red Versus Blue Team Exercises Laboratory Directed Research and Development project. The objective of this project was to advance scientific understanding concerning how to best structure training for cyber defenders. Two modes of training were considered. The baseline training condition (Tool-Based training) was based on current practices where classroom instruction focuses on the functions of a software tool with various exercises in which students apply those functions. In the second training condition (Narrative-Based training), classroom instruction addressed software functions, but in the context of adversary tactics and techniques. It was hypothesized that students receiving narrative-based training would gain a deeper conceptual understanding of the software tools and this would be reflected in better performance within a red versus blue team exercise.

97 MATHEMATICS AND COMPUTING↗

Formal Methods in Air Traffic Management: The Case of Unmanned Aircraft Systems

As the technological and operational capabilities of unmanned aircraft systems (UAS) continue to grow, so too does the need to introduce these systems into civil airspace. Unmanned Aircraft Systems Integration in the National Airspace System is a NASA research project that addresses the integration of civil UAS into non-segregated airspace operations. One of the major challenges of this integration is the lack of an onboard pilot to comply with the legal requirement that pilots see and avoid other aircraft. The need to provide an equivalent to this requirement for UAS has motivated the development of a detect and avoid (DAA) capability to provide the appropriate situational awareness and maneuver guidance in avoiding and remaining well clear of traffic aircraft. Formal methods has played a fundamental role in the development of this capability. This talk reports on the formal methods work conducted under NASA's Safe Autonomous System Operations project in support of the development of DAA for UAS. This work includes specification of low-level and high-level functional requirements, formal verification of algorithms, and rigorous validation of software implementations. The talk also discusses technical challenges in formal methods research in the context of the development and safety analysis of advanced air traffic management concepts.

Munoz, Cesar A.↗

Strategies for the Design and Operation of Resilient Extraterrestrial Habitats

An Earth-independent permanent extraterrestrial habitat system must function as intended under continuous disruptive conditions, and with significantly limited Earth support and extended uncrewed periods. Designing for the demands that extreme environments such as wild temperature fluctuations, galactic cosmic rays, destructive dust, meteoroid impacts (direct or indirect), vibrations, and solar particle events, will place on long-term deep space habitats represents one of the greatest challenges in this endeavor. This context necessitates that we establish the know-how and technologies to build habitat systems that are resilient. Resilience is not simply robustness or redundancy: it is a system property that accounts for both anticipated and unanticipated disruptions via the design choices and maintenance processes, and adapts to them in operation. We currently lack the frameworks and technologies needed to achieve a high level of resilience in a habitat system. The Resilient Extra Terrestrial Habitats Institute (RETHi) has the mission of leveraging existing novel technologies to provide situational awareness and autonomy to enable the design of habitats that are able to adapt, absorb and rapidly recover from expected and unexpected disruptions. We are establishing both fully virtual and coupled physical-virtual simulation capabilities that will enable us to explore a wide range of potential deep space Smart Hab configurations and operating modes.

Space habitats↗

Integration of In-Flight and Post-Flight Water Monitoring Resources in Addressing the U.S. Water Processor Assembly Total Organic Carbon (TOC) Anomaly

Beginning in June of 2010, the total organic carbon (TOC) concentration in the U.S. Water Processor Assembly (WPA) product water started to increase. A surprisingly consistent upward TOC trend was observed through weekly ISS total organic carbon analyzer (TOCA) monitoring. As TOC is a general organic compound indicator, return of water archive samples was needed to make better-informed crew health decisions on the specific compounds of concern and to aid in WPA troubleshooting. TOCA-measured TOC was more than halfway to the health-based screening limit of 3,000 g/L before archive samples were returned. Archive samples were returned on 22 Soyuz in September 2010 and on ULF5 in November of 2010. The samples were subjected to extensive analysis. Although TOC was confirmed to be elevated, somewhat surprisingly, none of the typical target compounds were detected at high levels. After some solid detective work, it was confirmed that the TOC was associated with a compound known as dimethylsilanediol (DMSD). DMSD is believed to be a breakdown product of siloxanes which are thought to be ubiquitous in the ISS atmosphere. A toxicological limit was set for DMSD and a forward plan was developed for conducting operations in the context of understanding the composition of the TOC measured in flight. This required careful consideration of existing ISS flight rules, coordination with ISS stakeholders, and development of a novel approach for the blending of inflight TOCA data with archive results to protect crew health. Among other challenges, team members had to determine how to utilize TOCA readings when making decisions about crew consumption of WPA water. This involved balancing very real concerns associated with the assumption that TOC would continue to be comprised of only DMSD. Demonstrated teamwork, multidisciplinary awareness, and innovative problem-solving were required to respond effectively to this anomaly.

Straub, John E., II↗

Grid Data Access on Widely Distributed Worker Nodes Using Scalla and SRM

Facing the reality of storage economics, NP experiments such as RHIC/STAR have been engaged in a shift of the analysis model, and now heavily rely on using cheap disks attached to processing nodes, as such a model is extremely beneficial over expensive centralized storage. Additionally, exploiting storage aggregates with enhanced distributed computing capabilities such as dynamic space allocation (lifetime of spaces), file management on shared storages (lifetime of files, pinning file), storage policies or a uniform access to heterogeneous storage solutions is not an easy task. The Xrootd/Scalla system allows for storage aggregation. We will present an overview of the largest deployment of Scalla (Structured Cluster Architecture for Low Latency Access) in the world spanning over 1000 CPUs co-sharing the 350 TB Storage Elements and the experience on how to make such a model work in the RHIC/STAR standard analysis framework. We will explain the key features and approach on how to make access to mass storage (HPSS) possible in such a large deployment context. Furthermore, we will give an overview of a fully 'gridified' solution using the plug-and-play features of Scalla architecture, replacing standard storage access with grid middleware SRM (Storage Resource Manager) components designed for space management and will compare the solution with the standard Scalla approach in use in STAR for the past 2 years. Integration details, future plans and status of development will be explained in the area of best transfer strategy between multiple-choice data pools and best placement with respect of load balancing and interoperability with other SRM aware tools or implementations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Aircraft Noise Perception Study in Brazil: A Perspective on Airport Sustainable Growth and Environmental Awareness

Aircraft noise perception is related to several variables that are tangible and objective, such as the number of operations, flight schedules. Other variables, instead, are more subjective, such as preferences. However, although their elusiveness, they contribute to determine the individuals' perception of this type of externality. Despite the fact that the complaints related to aeronautical noise have been registered since the decade of 50, it has been observed that the perception of noise seems to have grown, especially since the 80's. It has been argued that this change in noise perception has its roots on the accelerated expansion of air traffic. But, it is necessary to point out the important role played on modeling preferences, by the growing environmental conscience and the higher welfare and quality of life standards and expectations. In that context, the main objective of this paper is to study the aeronautical noise perception in the neighborhoods of the Aeroporto Internacional de Sao Paulo - AISP (the biggest airport of South America). Specifically, it analyzes the relationship between aircraft noise perception and social class, which is expected to be positive. Since noise perception is an intangible variable, this study chose as a proxy the value losses of residential properties, caused by aeronautical noise. The variable social class has been measured utilizing average per capita income of the population who live nearby the airport. The comparison of both, the lowest and the highest social class suggests that the relationship between social class and noise perception is positive in the AISP region. Moreover, it was observed that all social classes are very susceptible to aircraft noise annoyance. In fact, the magnitude of the noise perception proxy for both social classes -the residential value losses- was found to be comparable to levels encountered in developed countries.

deArantesGomesEller, Rogerio↗

NASA's Asteroid Redirect Mission: A Robotic Boulder Capture Option for Science, Human Exploration, Resource Utilization, and Planetary Defense

NASA is examining two options for the Asteroid Redirect Mission (ARM), which will return asteroid material to a Lunar Distant Retrograde Orbit (LDRO) using a robotic solar electric propulsion spacecraft, called the Asteroid Redirect Vehicle (ARV). Once the ARV places the asteroid material into the LDRO, a piloted mission will rendezvous and dock with the ARV. After docking, astronauts will conduct two extravehicular activities (EVAs) to inspect and sample the asteroid material before returning to Earth. One option involves capturing an entire small (~4 - 10 m diameter) near-Earth asteroid (NEA) inside a large inflatable bag. However, NASA is also examining another option that entails retrieving a boulder (~1 - 5 m) via robotic manipulators from the surface of a larger (~100+ m) pre-characterized NEA. The Robotic Boulder Capture (RBC) option can leverage robotic mission data to help ensure success by targeting previously (or soon to be) well- characterized NEAs. For example, the data from the Japan Aerospace Exploration Agency's (JAXA) Hayabusa mission has been utilized to develop detailed mission designs that assess options and risks associated with proximity and surface operations. Hayabusa's target NEA, Itokawa, has been identified as a valid target and is known to possess hundreds of appropriately sized boulders on its surface. Further robotic characterization of additional NEAs (e.g., Bennu and 1999 JU3) by NASA's OSIRIS REx and JAXA's Hayabusa 2 missions is planned to begin in 2018. This ARM option reduces mission risk and provides increased benefits for science, human exploration, resource utilization, and planetary defense. Science: The RBC option is an extremely large sample-return mission with the prospect of bringing back many tons of well-characterized asteroid material to the Earth-Moon system. The candidate boulder from the target NEA can be selected based on inputs from the world-wide science community, ensuring that the most scientifically interesting boulder be returned for subsequent sampling. In addition, the material surrounding the boulder can be collected from the surface, thus providing geological contextual information and additional samples of NEA regolith. The robotic manipulators used for capturing the boulder will ensure some of the surface remains undisturbed and that the boulder will retain its structural integrity, which will preserve the context of any samples collected by the astronauts and ensure a high level of science return. Human Exploration: Due to the coherent nature of the boulder that will be collected, entire encapsulation of the asteroid material is not required. This facilitates exploration and sample collection of the boulder by astronauts in a variety of ways. The total time for EVA during the crew portion of the mission is very limited. Current estimates are that each of the two EVAs will only last four hours. The RBC option will allow crew members to have good situational awareness of the work site and quickly identify sample sites of interest. In addition, the samples to be collected can be readily accessed without having to deal with removal of an encapsulation system, which adds extra complexity and risk for the astronauts during EVA. Resource Utilization: One of the most crucial aspects for resource utilization is the identification and collection of appropriate materials (e.g., volatiles, organics, metals, etc.) that contain components of interest. Prior characterization of NEAs is required in order to increase the likelihood that appropriate materials will be returned. Ground-based observations of small (<10 m) NEAs are challenging, but characterization efforts of larger targets have demonstrated that NEAs with volatiles and organics have been identified. Two potential targets for the RBC option (Bennu and 1999 JU3) have been previously identified as potentially rich in resources, and both are already targets of currently planned robotic missions that will characterize their physical properties in great detail. Planetary Defense: The RBC option involves interaction with a well- characterized potentially hazardoussized NEA that would enable NASA to conduct one or more planetary defense demonstrations. The primary method would use the collected boulder to augment the mass of the ARV and perform an Enhanced Gravity Tractor (EGT) demonstration on the NEA. Additionally, other approaches could be demonstrated during the mission, such as Ion Beam Deflection (IBD) and/or observation of a Kinetic Impactor (KI). The relative effectiveness of a slow push-pull method such as the EGT or IBD could be directly compared and contrasted with the results of the more energetic KI method on the target NEA. Conclusions: This boulder option for NASA's ARM can leverage knowledge of previously characterized NEAs from prior robotic missions, which provides more certainty of the target NEA's physical characteristics and reduces mission risk. This increases the return on investment for NASA's future activities with respect to human exploration, resource utilization, and planetary defense.

Abell, P.↗

Systems-To-Atoms (S2A): enabling hydrogen for climate security

The project addresses a critical gap in hydrogen infrastructure by integrating system-level energy models with atomic-scale material simulations in a unified Systems-to-Atoms (S2A) framework. The motivation stems from the need to develop efficient, cost-effective, and durable hydrogen transport and utilization technologies to support decarbonization of hard-to-electrify sectors such as heavy-duty transportation. Current system models lack awareness of material performance mechanisms, while material-scale models do not account for system-level usage and variability. To bridge this divide, the team developed a co-simulation capability linking techno-economic analyses, reactor/process-flow modeling, and molecular-scale catalysis simulations. Applied to hydrogen delivery in California, the framework enabled comparative evaluations of compressed, cryogenic, and liquid organic hydrogen carrier (LOHC) pathways, highlighting how catalyst operation and unit process efficiency influence overall performance. The results demonstrate that no single material or transport mode is universally optimal; instead, heterogeneous solutions tuned to specific operational contexts deliver better performance. The project delivers a new capability for cross-scale material co-design, advancing hydrogen infrastructure readiness and informing DOE and LLNL missions in climate and energy resilience.

organic↗

Method for Tracking and Communicating Aggregate Risk Through the Use of Model-Based Systems Engineering (MBSE) Tools

Large, complex projects can identify a significant number and variety of risks, throughout the project life cycle. These risks are analyzed, mitigated, closed or accepted as independent uncertainties. Once closed or accepted, it is easy for projects to lose awareness of their impact. In reality, each of these risks contributes some amount to the overall risk posture of the project. The ability to track and effectively communicate this aggregate risk has represented a challenge to project management. There have been previous attempts to create a schema to communicate the aggregate effect of risks, without notable success. Most of these attempts have centered on some additive metric derived from the scoring of likelihood and consequence values. This, in and of itself, is a logical approach, but all too often the scores were then aggregated to a level where all context was lost. One weakness has been a lack of attempt to create linkages or logical groups of the risks upon which useful aggregation could then occur. The overall move to model-based (systems) engineering (MBSE) has opened up a vast frontier of opportunities to better integrate all project data. MBSE provides an underlying layer that links data items to each other. Objectives link to requirements, which then link to functions, functions to physical architecture items, and so on, as far down as projects want to model. While it started with a focus on modeling requirements based on things like use cases, efforts are now underway to integrate safety and mission assurance (S&MA) information and analyses, such as risks. This effort, called Model Based Mission Assurance (MBMA), is yielding models that are more useful and are a more accurate representations of the systems. MBSE models, with this ability to link related items, provide a new means of tracking and communicating aggregate risks. In the proposed method, risks are added into the models as distinct items, having attributes that communicate a scoring derived from the likelihood and consequence values as charted on the standard NASA 5x5 risk matrix. Like earlier efforts, each box in the 5x5 has an associated scoring, which may include both a current score and potential post-mitigation/control score. The risk items are then linked to elements of the model, such as system objectives/goals, requirements, functions, or physical architecture items, with "Risk to" relationships. These risks will then be communicated by use of reports generated from the model, detailing all risks and/or hazards linked to model elements. These reports can include aggregate impacts, including a current scoring and potential future state scoring based on the planned mitigations and/or controls. These reports will show all risks, open, accepted, and closed, linked to project objectives or requirements. When run as part of an upcoming risk acceptance discussion, these reports will serve to remind the team of all previous risks that relate to the effected portion of the system. When included as part of periodic program or project reviews, risk reviews, and safety reviews, this method can improve the overall understanding of the system's true risk posture. This proposed method takes full advantage of the advances that modern modeling techniques provide, with a minimal investment of additional time. Utilizing the model environment also enables a near constant access to current state of aggregate risks.

model based mission assurance↗

Intelligent Systems Technologies to Assist in Utilization of Earth Observation Data

With the launch of several Earth observing satellites over the last decade, we are now in a data rich environment. From NASA's Earth Observing System (EOS) satellites alone, we are accumulating more than 3 TB per day of raw data and derived geophysical parameters. The data products are being distributed to a large user community comprising scientific researchers, educators and operational government agencies. Notable progress has been made in the last decade in facilitating access to data. However, to realize the full potential of the growing archives of valuable scientific data, further progress is necessary in the transformation of data into information, and information into knowledge that can be used in particular applications. Sponsored by NASA s Intelligent Systems Project within the Computing, Information and Communication Technology (CICT) Program, a conceptual architecture study has been conducted to examine ideas to improve data utilization through the addition of intelligence into the archives in the context of an overall knowledge building system. Potential Intelligent Archive concepts include: 1) Mining archived data holdings using Intelligent Data Understanding algorithms to improve metadata to facilitate data access and usability; 2) Building intelligence about transformations on data, information, knowledge, and accompanying services involved in a scientific enterprise; 3) Recognizing the value of results, indexing and formatting them for easy access, and delivering them to concerned individuals; 4) Interacting as a cooperative node in a web of distributed systems to perform knowledge building (i.e., the transformations from data to information to knowledge) instead of just data pipelining; and 5) Being aware of other nodes in the knowledge building system, participating in open systems interfaces and protocols for virtualization, and collaborative interoperability. This paper presents some of these concepts and identifies issues to be addressed by research in future intelligent systems technology.

Ramapriyan, Hampapuram K.↗

OpenABLext: An automatic code generation framework for agent-based simulations on CPU-GPU-FPGA heterogeneous platforms

The execution of agent-based simulations (ABSs) on hardware accelerator devices such as graphics processing units (GPUs) has been shown to offer great performance potentials. However, in heterogeneous hardware environments, it can become increasingly difficult to find viable partitions of the simulation and provide implementations for different hardware devices. To automate this process, we present OpenABLext, an extension to OpenABL, a model specification language for ABSs. By providing a device-aware OpenCL backend, OpenABLext enables the co-execution of ABS on heterogeneous hardware platforms consisting of central processing units, GPUs, and field programmable gate arrays (FPGAs).We present a novel online dispatching method that efficiently profiles partitions of the simulation during run-time to optimize the hardware assignment while using the profiling results to advance the simulation itself. In addition, OpenABLext features automated conflict resolution based on user-specified rules, supports graph-based simulation spaces, and utilizes an efficient neighbor search algorithm. We show the improved performance of OpenABLext and demonstrate the potential of FPGAs in the context of ABS. We illustrate how co-execution can be used to further lower execution times. OpenABLext can be seen as an enabler to tap the computing power of heterogeneous hardware platforms for ABS.

97 MATHEMATICS AND COMPUTING↗

Human Capabilities Assessments for Autonomous Missions: A Multi-Team Research Effort to Reduce Risk in the Human-System Integration Architecture for Future Deep-Space Missions

In future exploration missions beyond low earth-orbit, crew will have to execute complex operations and respond to off-nominal events, without real-time support from Mission Control. It is anticipated that increased reliance on automated systems, including human-centric vehicle and information architecture, will need to be designed to support the crew; increased risk to performance, health, and safety may occur if these are not implemented appropriately. The Human Factors and Behavioral Performance Element (HFBP) in the NASA Human Research Program supports research to characterize and mitigate such human health and performance risks, including the Risk of Adverse Outcome Due to Inadequate Human Systems Integration Architecture (HSIA). The HSIA risk addresses the integration of onboard capability and the crew roles and responsibilities necessary to enable the crew to respond effectively and efficiently in the increasingly autonomous mission operations environment. In 2017, HFBP released the “Human Capabilities Assessments for Autonomous Missions” (HCAAM) research topic to address HSIA related questions. HCAAM is a major NASA research effort that has assembled a multidisciplinary team from seven institutions to work closely with design and engineering efforts on research towards developing and refining human performance standards, guidelines and automation tools. The scientific focus is on quantitative assessment of human capabilities relevant to future deep-space missions during which earth/spacecraft communication is so delayed and intermittent that the crew must be able to function autonomously. The integrated strategy of the HCAAM project characterizes human capabilities and limitations related to potential performance decrements during long duration exploration mission spaceflight as relevant to both routine and complex task performance; defines system characteristics that reduce the likelihood or impact of potential decrements in human performance capabilities; performs integrated assessment of intelligent system responses within the context of an operational environment with relevant NASA tools, systems, and data structures in order to determine positive or negative interactions and validate recommended approaches; and proposes specific updates to existing standards and guidelines for inclusion in NASA handbooks for the design of future spacecraft intelligent systems that provide crew performance assessment/feedback, and to also serve as decision-support aids for the onboard crew (i.e., NASA-STD-3001, and NASA/SP-Human Integration Design Handbook (HIDH)). The scientific research vectors being addressed by the seven HCAAM teams include: - crew task performance (accuracy, efficiency) (crew + automation) - crew performance (accuracy, efficiency) - crew Situation Awareness - procedure design and multi-modal enhancement - concurrent tasking (mixed manual + some level of autonomy) - task handover - crew self-planning and time-lining - task design - trust in automation, real-time calibration - human multi-sensory feedback and guidance - human trust in on-board software-based intelligent assistants - virtual assistants The presentation will highlight plans and progress made in each of these research areas as well as the methods by which surrogate astronaut crews in the NASA JSC HERA spaceflight analog facility will function as human test subjects for all of the HCAAM research projects.

HCAAM VNSCOR↗

Retrieval Augmented Generation for Robust Cyber Defense

In cybersecurity, the ability to efficiently analyze and respond to vulnerabilities, weaknesses, attack patterns, and threat tactics is critical for effective defense strategies. With the increasing complexity and volume of cybersecurity data, traditional methods of querying and retrieving information are often inadequate. To address this challenge, we implemented Retrieval-Augmented Generation (RAG) systems—CyRAG and GraphCyRAG—that integrate large language models (LLMs) with both structured data from relational databases and knowledge graphs such as Neo4j. CyRAG is designed to handle structured data, focusing on CVE (Common Vulnerabilities and Exposures) and CWE (Common Weakness Enumeration) entities to generate accurate and context-rich responses. In contrast, GraphCyRAG leverages Neo4j knowledge graphs to retrieve interconnected information from CVE, CWE, CAPEC (Common Attack Pattern Enumeration and Classification), and ATT&CK (Adversarial Tactics, Techniques, and Common Knowledge) datasets. By utilizing Neo4j’s graph-based framework, GraphCyRAG enables deeper traversal of relationships between vulnerabilities and attack patterns, providing cybersecurity analysts with more comprehensive insights into potential attack vectors and mitigation strategies. Our preliminary results demonstrate that integrating knowledge graphs with RAG significantly enhances both the accuracy and depth of threat analysis, allowing for the retrieval of dynamic, real-time data and the generation of contextually aware responses. This approach helps analysts uncover hidden relationships between cyber entities, predict exploit paths, and prioritize mitigation efforts effectively. The integration of RAG with cybersecurity knowledge graphs represents a significant advancement in cybersecurity threat intelligence, enabling more informed decision-making and stronger defense strategies.

97 MATHEMATICS AND COMPUTING↗

Interactive Rotated Object Detection for Novel Class Detection in Remotely Sensed Imagery

In this paper we propose IRTR-DETR an Interactive and Real-Time Rotated DEtection TRansformer that extends IRTDETR to predict rotated bounding boxes. IRTR-DETR maintains the Human-In-The-Loop (HIL) workflow of IRTDETR but introduces rotation-aware heads for improved detection of objects with arbitrary orientations. Similarly to IRTDETR IRTR-DETR can be trained with a small labeled sample set in an interactive setting but we show that it can also be pretrained on related but not identical data--such as a building damage dataset--before being applied to tasks like identifying buildings under construction. We demonstrate the efficacy of our approach on the publicly available Tiny-DOTA and xBD dataset as well as two study-cases on proprietary datasets of greenhouses and houses under construction ("waffle homes"). Detecting greenhouses is highly relevant in the context of damage assessment while "waffle homes" aid understanding typical floorplans and building codes in different areas both thereby supporting population modeling emergency response and policy planning. Our method outperforms the state of the art in interactive rotated object detection on the Tiny-DOTA dataset by 5.7 percent and improves upon the non interactive RTDETR by 7.85 to 19.39 percent (depending on the number of provided samples) while maintaining its real-time efficiency.

Burges, Marvin [ORNL] (ORCID:0000000312690769)↗

Integrated Display and Environmental Awareness System - System Architecture Definition

The Integrated Display and Environmental Awareness System (IDEAS) is an interdisciplinary team project focusing on the development of a wearable computer and Head Mounted Display (HMD) based on Commercial-Off-The-Shelf (COTS) components for the specific application and needs of NASA technicians, engineers and astronauts. Wearable computers are on the verge of utilization trials in daily life as well as industrial environments. The first civil and COTS wearable head mounted display systems were introduced just a few years ago and they probed not only technology readiness in terms of performance, endurance, miniaturization, operability and usefulness but also maturity of practice in perspective of a socio-technical context. Although the main technical hurdles such as mass and power were addressed as improvements on the technical side, the usefulness, practicality and social acceptance were often noted on the side of a broad variety of humans' operations. In other words, although the technology made a giant leap, its use and efficiency still looks for the sweet spot. The first IDEAS project started in January 2015 and was concluded in January 2017. The project identified current COTS systems' capability at minimum cost and maximum applicability and brought about important strategic concepts that will serve further IDEAS-like system development.

Wearables↗