Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “agent based”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Multi-agent AI collaboration for digital twin development and assessment

Developing a digital twin (DT) model involves different steps that encompass formulating requirements, model development, implementation, and assessment with respect to real applications. Human expertise is required to coordinate and implement different steps in the DT development and assessment process. However, certain parts of this process can be automated using artificial intelligence (AI) agents for efficient workflow development. In this work, we test and analyze a multiagent AI collaboration with humans in the loop to automate different elements of the DT development and assessment process. To implement the workflow for multiagent AI DT development and assessment, we use Autogen, a multiagent framework developed by Microsoft. Autogen offers a modular and flexible framework for configuring and designing task-specific multiagent workflows. In this framework, large language models (LLMs) form the core intelligence of the AI agents where the quality and performance of the automated element is governed by the inherent capabilities and knowledge base of the LLM. We use retrieval augmented generation to supplement the LLM with relevant domain-specific information for DT requirement formulation. We illustrate this multiagent workflow using a case study on a thermal energy storage system, focusing on how AI agents can collaborate with humans to expedite and optimize different elements of DT development and assessment process.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Meeting the Deadline: Why, When and How

A normative system is defined as any set of interacting agents whose behavior can usefully be regarded as norm-directed. Most organizations, and more specifically institutions, fall under this definition. Interactions in these normative systems are regulated by normative templates that describe desired behavior in terms of deontic concepts (obligations, prohibitions and permissions), deadlines, violations and sanctions. Agreements between agents, and between an agent and the society, can then be specified by means of contracts. Contracts provide flexible but verifiable means to integrate society requirements and agent autonomy. and are an adequate means for the explicit specification of interactions. From the society perspective, it is important that these contracts adhere to the specifications described in the model of the organization. If we want to automate such verifications, we have to formalize the languages used for contracts and for the specification of organizations. The logic LCR is based on deontic temporal logic. LCR is an expressive language for describing interaction in multi-agent systems, including obligations with deadlines. Deadlines are important norms in most interactions between agents. Intuitively, a deadline states that an agent should perform an action before a certain point in time. The obligation to perform the action starts at the moment the deadline becomes active. E.g. when a contract is signed or approved. If the action is not performed in time a violation of the deadline occurs. It can be specified independently what measure has to be taken in this case. In this paper we investigate the deadline concept in more detail. The paper is organized as follows. Section 2 defines the variant of CTL we use. In section 3, we discuss the basic intuitions of deadlines. Section 4 presents a first intuitive formalization for deadlines. In section 5, we look at a more complex model for deadlines trying to catch some more practical aspects. Finally, in section 6 we present issues for future work and our conciusions.

Dignum, Frank↗

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

PCR Based Microbial Monitor for Analysis of Recycled Water Aboard the ISSA: Issues and Prospects

The monitoring of spacecraft life support systems for the presence of health threatening microorganisms is paramount for crew well being and successful completion of missions. Development of technology to monitor spacecraft recycled water based on detection and identification of the genetic material of contaminating microorganisms and viruses would be a substantial improvement over current NASA plans to monitor recycled water samples that call for the use of conventional microbiology techniques which are slow, insensitive, and labor intensive. The union of the molecular biology techniques of DNA probe hybridization and polymerase chain reaction (PCR) offers a powerful method for the detection, identification, and quantification of microorganisms and viruses. This technology is theoretically capable of assaying samples in as little as two hours with specificity and sensitivity unmatched by any other method. A major advance in probe-hybridization/PCR has come about in a technology called TaqMan(TM), which was invented by Perkin Elmer. Instrumentation using TaqMan concepts is evolving towards devices that could meet NASA's needs of size, low power use, and simplicity of operation. The chemistry and molecular biology needed to utilize these probe-hybridization/PCR instruments must evolve in parallel with the hardware. The following issues of chemistry and biology must be addressed in developing a monitor: Early in the development of a PCR-based microbial monitor it will be necessary to decide how many and which organisms does the system need the capacity to detect. We propose a set of 17 different tests that would detect groups of bacteria and fungus, as well as specific eukaryotic parasites and viruses; In order to use the great sensitivity of PCR it will be necessary to concentrate water samples using filtration. If a lower limit of detection of 1 microorganism per 100 ml is required then the microbes in a 100 ml sample must be concentrated into a volume that can be added to a PCR assay; There are not likely to be contaminants in ISSA recycled water that would inhibit PCR resulting in false-negative results; The TaqMan PCR product detection system is the most promising method for developing a rapid, highly automated gene-based microbial monitoring system. The method is inherently quantitative. NASA and other government agencies have invested in other technologies that, although potentially could lead to revolutionary advances, are not likely to mature in the next 5 years into working systems; PCR-based methods cannot distinguish between DNA or RNA of a viable microorganism and that of a non-viable organism. This may or may not be an important issue with reclaimed water on the ISSA. The recycling system probably damages the capacity of the genetic material of any bacteria or viruses killed during processing to serve as a template in a PCR desinged to amplify a large segment of DNA (less than 650 base pairs). If necessary, vital dye staining could be used in addition to PCR, to enumerate the viable cells in a water sample; The quality control methods have been developed to insure that PCR's are working properly, and that reactions are not contaminated with PCR carryover products which could lead to the generation of false-positive results; and The sequences of the small rRNA subunit gene for a large number of microorganisms are known, and they consititue the best database for rational development of the oligonucleotide reagents that give PCR its great specificity. From those gene sequences, sets of oligonucleotide primers for PCR and Taqman detection that could be used in a NASA microbial monitor were constructed using computer based methods. In addition to space utilization, a microbial monitior will have tremendous terrestrial applications. Analysis of patient samples for microbial pathogens, testing industrial effluent for biofouling bacteria, and detection biological warfare agents on the battlefield are but a few of the diverse potential uses for this technology. Once fully developed, gene-based microbial monitors will become the fundamental tool in every lab that tests for microbial contaminants, and serve as a powerful weapon in mankind's war with the germ world.

Cassell, Gail H.↗

Towards philosophical reasoning with agentic LLMs: Socratic method for scientific assistance

As large language models (LLMs) become central tools in science, improving their reasoning capabilities is critical for meaningful and trustworthy applications. We introduce a Socratic agent for scientific reasoning, implemented through a structured system prompt that guides LLMs via classical principles of inquiry. Unlike typical prompt engineering or retrieval-based methods, our approach leverages definition, analogy, hypothesis elimination, and other Socratic techniques to generate more coherent, critical, and domain-aware responses. We evaluate the agent across diverse scientific domains and benchmark it on the abstraction and reasoning corpus challenge dataset, achieving 97.15% under a fixed prompting protocol and without fine-tuning or external tools. Expert evaluation shows improved reasoning depth, clarity, and adaptability over conventional LLM outputs, suggesting that structured prompting rooted in philosophical reasoning can improve the scientific utility of language models.

LLM reasoning↗

Evidence for crystalline hematite as an accessory phase in Martian soils

Based on visible and near-IR spectral images of Mars obtained by us in 1988, we have confirmed the occurrence of bulk crystalline hematite as a minor or accessory phase on the surface. This hematite is not uniformly distributed, being less abundant or absent in certain northern low-albedo regions. Even where most abundant, bulk hematite is not the primary coloring agent of heavily weathered materials on Mars. The primary coloring agent is apparently an amorphous or nanophase Fe3(+) phase, analogous to the coloring agent in certain Hawaiian palagonites (e.g. Adams and Evans, 1980; Singer, 1982; Morris et al, 1989). Based on these results, we can say with considerable certainty that bulk crystalline hematite exists on Mars in small amounts, in addition to the more ubiquitous nanophase or poorly crystalline ferric oxide phase(s). We conclude that Type 2 low-albedo regions (typified by Acidalia Planitia) contain less of this hematite than Type 1 regions (typified by Meridiani Sinus). Oxia Palus shows indication of slightly more oxidation and bulk hematite than Acidalia. This may be a real compositional difference, indicating that Oxia is in some sense transitional between Type 2 and Type 1 regions, but we cannot rule out the possibility of some optical mixing with surrounding higher-albedo regions. We are currently investigating the relationship of ferric-oxides in high-albedo regions to both types of low-albedo regions. As expected, spectral ratios of data from western Arabia to dark regions show considerably greater Fe3(+) in Arabia. There are not obvious spectral indications of a difference in ferric-oxide composition between Arabia and Type 1 low-albedo regions, implying that Arabia also contains minor bulk hematite.

Singer, R. B.↗

Detection and Mitigation of Transient Instabilities in Multi-Agent Systems and Swarms

We first introduce the novel concept of transient instabilities in multi-agent systems and swarms, i.e., a small disturbance leads to increasing-amplitude oscillations throughout the swarm, which results in a large number of inter-agent collisions. This instability is dominant in the transient phase of the system and it does not appear in the steady-state behavior of the system, as each agent uses Lyapunov-stable feedback control laws. We present a rigorous definition of transient instability in swarms, and discuss its key properties. We also present a sufficient condition to check if a swarm will be transient stable. We study the behaviour of different control laws under this condition. We also show how transient instability phenomenon could impact the dynamics of deployable structures. Next, we present a novel control architecture that augments the baseline formation maintenance controller to mitigate transient instabilities. At its heart, the proposed architecture consists of a projection operator based estimator disguised as a reference model that generates collision-free trajectories for the agents to follow. We present numerical simulation results to demonstrate the effectiveness of our proposed approaches.

Quadrelli, Marco B.↗

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion-suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches.The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

Fire Suppression in Low Gravity Using a Cup Burner

Longer duration missions to the moon, to Mars, and on the International Space Station increase the likelihood of accidental fires. The goal of the present investigation is to: (1) understand the physical and chemical processes of fire suppression in various gravity and O2 levels simulating spacecraft, Mars, and moon missions; (2) provide rigorous testing of numerical models, which include detailed combustion suppression chemistry and radiation sub-models; and (3) provide basic research results useful for advances in space fire safety technology, including new fire-extinguishing agents and approaches. The structure and extinguishment of enclosed, laminar, methane-air co-flow diffusion flames formed on a cup burner have been studied experimentally and numerically using various fire-extinguishing agents (CO2, N2, He, Ar, CF3H, and Fe(CO)5). The experiments involve both 1g laboratory testing and low-g testing (in drop towers and the KC-135 aircraft). The computation uses a direct numerical simulation with detailed chemistry and radiative heat-loss models. An agent was introduced into a low-speed coflowing oxidizing stream until extinguishment occurred under a fixed minimal fuel velocity, and thus, the extinguishing agent concentrations were determined. The extinguishment of cup-burner flames, which resemble real fires, occurred via a blowoff process (in which the flame base drifted downstream) rather than the global extinction phenomenon typical of counterflow diffusion flames. The computation revealed that the peak reactivity spot (the reaction kernel) formed in the flame base was responsible for attachment and blowoff of the trailing diffusion flame. Furthermore, the buoyancy-induced flame flickering in 1g and thermal and transport properties of the agents affected the flame extinguishment limits.

Takahashi, Fumiaki↗

Autonomous In-space Construction, Maintenance, and Reconfiguration Using Programmable Meta-Material

NASA ARC's Coded Structures Laboratory (CSL) is developing autonomous construction, maintenance, and reconfiguration technologies to meet long-duration and deep space infrastructure needs, in accordance with long-term NASA goals of "in-space reliance" and "mass-less exploration." We seek to achieve these capabilities by utilizing a "programmable meta-material" approach that integrates emerging advances in materials (mechanical meta-materials), manufacturing (cooperative mobile robotics), and autonomy (multi-agent planning algorithms). Through the ARMADAS project, we have shown assembly of high-performance engineered cellular materials using multiple cooperating mobile robotic assemblers. In this paper, we describe how such a programmable meta-material architecture may shift the paradigm of how we design, build, manufacture, and operate future space infrastructure and assets. The core of a programmable meta-material architecture consists of 3 main technology sub-areas: the structure, the assembly agents, and the assembly algorithms. We co-design these systems to ensure an adaptable system that can create and reconfigure structures from a base set of building block components. From this core technology, we can branch out and expand the capability of the system through additional secondary component types and robotic agents to perform activities such as inspections, maintenance, repair, payload installation, or perform power and communications interconnect. As these technologies mature, future designers will be able to utilize the system to rapidly integrate and operate assets in space or on planetary surfaces from a set of well-tested part library, or create their own modules to integrate into the system. A core trait to the development of this system is the automation approach. Because of the modular and functional discrete (pixel-like) nature of the structural system, a diverse set of powerful algorithms for analysis, planning, and simulation can be adapted and leveraged to optimize construction, maintenance, and dynamic reorganization (as hardware with programmable form and function). With an ability to free the design space from launch vehicle constraints and fundamentally shift how a mission is designed and conducted, we discuss the influence of a programmable meta-material architecture on mission design, build, and operations. For the "design phase", we discuss project lifecycle effects, costs, time, and performance. For the "build phase", we discuss reusability, ISRU, manufacturing, material logistics, and scalability. And for "operations", we discuss autonomy, maintenance and upgrades, reliability, and reconfiguration. Autonomy and modularity are the primary enabling traits of this system. Engineering systems that utilize a modular and reconfiguration building block approach such as digital communication and computation systems, currently lead all other areas of technology in size and complexity scalability. NASA is extending the benefits and flexibility of digital systems to hardware systems, to optimize materials lifecycle management and expand our space exploration mission capabilities.

in space assembly↗

Forest Disturbance Across the Conterminous United States from 1985-2012: The Emerging Dominance of Forest Decline

Evidence of shifting dominance among major forest disturbance agent classes regionally to globally has been emerging in the literature. For example, climate-related stress and secondary stressors on forests (e.g., insect and disease, fire) have dramatically increased since the turn of the century globally, while harvest rates in the western US and elsewhere have declined. For shifts to be quantified, accurate historical forest disturbance estimates are required as a baseline for examining current trends. We report annual disturbance rates (with uncertainties) in the aggregate and by major change causal agent class for the conterminous US and five geographic subregions between 1985 and 2012. Results are based on human interpretations of Landsat time series from a probability sample of 7200 plots (30 m) distributed throughout the study area. Forest disturbance information was recorded with a Landsat time series visualization and data collection tool that incorporates ancillary high-resolution data. National rates of disturbance varied between 1.5% and 4.5% of forest area per year, with trends being strongly affected by shifting dominance among specific disturbance agent influences at the regional scale. Throughout the time series, national harvest disturbance rates varied between one and two percent, and were largely a function of harvest in the more heavily forested regions of the US (Mountain West, Northeast, and Southeast). During the first part of the time series, national disturbance rates largely reflected trends in harvest disturbance. Beginning in the mid-90s, forest decline-related disturbances associated with diminishing forest health (e.g., physiological stress leading to tree canopy cover loss, increases in tree mortality above background levels), especially in the Mountain West and Lowland West regions of the US, increased dramatically. Consequently, national disturbance rates greatly increased by 2000, and remained high for much of the decade. Decline-related disturbance rates reached as high as 8% per year in the western regions during the early-2000s. Although low compared to harvest and decline, fire disturbance rates also increased in the early- to mid-2000s. We segmented annual decline-related disturbance rates to distinguish between newly impacted areas and areas undergoing gradual but consistent decline over multiple years. We also translated Landsat reflectance change into tree canopy cover change information for greater relevance to ecosystem modelers and forest managers, who can derive better understanding of forest-climate interactions and better adapt management strategies to changing climate regimes. Similar studies could be carried out for other countries where there are sufficient Landsat data and historic temporal snapshots of high-resolution imagery.

Cohen, Warren B.↗

Physics Informed Reinforcement Learning for Power Grid Control using Augmented Random Search

Wide adoption of deep reinforcement learning need to overcome several challenges in energy system domain, including scalability, learning from limited samples, and high-dimensional continuous state and action spaces. In this paper, we integrated physics-based information from the normal generator operation state formula in the reinforcement learning agent's neural network loss function, and applied an augmented random search agent to optimize the generator control under dynamic contingency. Simulation results demonstrated the reliability performance improvements in training speed, reward convergence, sampling efficiency, scalability, and transferability.

physics informed ML, Physics Informed Neural Netwo↗

Likeness: a toolkit for connecting the social fabric of place to human dynamics

The ability to produce richly-attributed synthetic populations is key for understanding human dynamics, responding to emergencies, and preparing for future events, all while protecting individual privacy. The Likeness toolkit accomplishes these goals with a suite of Python packages: pymedm/pymedm\_legacy, livelike, and actlike. This production process is initialized in pymedm (or pymedm\_legacy) that utilizes census microdata records as the foundation on which disaggregated spatial allocation matrices are built. The next step, performed by livelike, is the generation of a fully autonomous agent population attributed with hundreds of demographic census variables. The agent population synthesized in livelike is then attributed with residential coordinates in actlike based on block assignment and, finally, allocated to an optimal daytime activity location via the street network. We present a case study in Knox County, Tennessee, synthesizing 30 populations of public K–12 school students \& teachers and allocating them to schools. Validation of our results shows they are highly promising by replicating reported school enrollment and teacher capacity with a high degree of fidelity.

Tuccillo, Joe↗

Carbide Nanoparticle Dispersion Techniques for Metal Powder Metallurgy

Nanoparticles (NP) embedded into a matrix material have been shown to improve mechanical properties such as strength, hardness, and wear-resistance. However, the tendency of NPs to agglomerate in the powder mixing process is a major concern. This study investigates five different mechanochemical processing (MCP) routes to mitigate agglomeration to achieve a uniform dispersion of ZrC NPs in an Fe-based metal matrix composite. Our results suggest that MCP with only process controlling agents is ineffective in avoiding aggregation of these NPs. Instead, the uniformity of the carbide NP dispersion is achieved by pre-dispersing the NPs under ultrasonication using suitable surfactants followed by mechanically mixing of the NPs with iron powders in an alcohol solvent which is then dried. High-energy MCP is then used to embed the NPs within the powders. These collective steps resulted in a uniform dispersion of ZrC in the sintered (consolidated) Fe sample.

08 HYDROGEN↗

Replacements For Ozone-Depleting Foaming Agents

Fluorinated ethers used in place of chlorofluorocarbons and hydrochlorofluorocarbons. Replacement necessary because CFC's and HCFC's found to contribute to depletion of ozone from upper atmosphere, and manufacture and use of them by law phased out in near future. Two fluorinated ethers do not have ozone-depletion potential and used in existing foam-producing equipment, designed to handle liquid blowing agents soluble in chemical ingredients that mixed to make foam. Any polyurethane-based foams and several cellular plastics blown with these fluorinated ethers used in processes as diverse as small batch pours, large sprays, or double-band lamination to make insulation for private homes, commercial buildings, shipping containers, and storage tanks. Fluorinated ethers proved useful as replacements for CFC refrigerants and solvents.

Blevins, Elana↗

The Extinction of Low Strain Rate Diffusion Flames by a Suppressant

This paper describes plans for an experimental and computational study on the structure and extinction of low strain rate diffusion flames by a suppressant added to the oxidizer stream. Stable low strain rate flames will be established through ground based reduced gravity experiments using the 2.2 s drop tower. A variety of agents will be investigated, including both physically and chemically acting agents (He, N2, CO2, and CF3Br) for flames burning methane and propane. A computational model of flame structure and extinction will be modified to include radiative losses, which is thought to be a significant heat loss mechanism at low strain rates.

Hamins, A.↗

Contamination Analyzer

Measurement of the total organic carbon content in water is important in assessing contamination levels in high purity water for power generation, pharmaceutical production and electronics manufacture. Even trace levels of organic compounds can cause defects in manufactured products. The Sievers Model 800 Total Organic Carbon (TOC) Analyzer, based on technology developed for the Space Station, uses a strong chemical oxidizing agent and ultraviolet light to convert organic compounds in water to carbon dioxide. After ionizing the carbon dioxide, the amount of ions is determined by measuring the conductivity of the deionized water. The new technique is highly sensitive, does not require compressed gas, and maintenance is minimal.

Source record↗

Large File Transfers from Space Using Multiple Ground Terminals and Delay-Tolerant Networking

We use Delay-Tolerant Networking (DTN) to break control loops between space-ground communication links and ground-ground communication links to increase overall file delivery efficiency, as well as to enable large files to be proactively fragmented and received across multiple ground stations. DTN proactive fragmentation and reactive fragmentation were demonstrated from the UK-DMC satellite using two independent ground stations. The files were reassembled at a bundle agent, located at Glenn Research Center in Cleveland Ohio. The first space-based demonstration of this occurred on September 30 and October 1, 2009. This paper details those experiments. Communication, delay-tolerant networking, DTN, satellite, Internet, protocols, bundle, IP, TCP.

Ivancic, William D.↗