Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

MESA: Message-Based System Analysis Using Runtime Verification

In this paper, we present a novel approach and framework for run-time verication of large, safety critical messaging systems. This work was motivated by verifying the System Wide Information Management (SWIM) project of the Federal Aviation Administration (FAA). SWIM provides live air traffic, site and weather data streams for the whole National Airspace System (NAS), which can easily amount to several hundred messages per second. Such safety critical systems cannot be instrumented, therefore, verification and monitoring has to happen using a nonintrusive approach, by connecting to a variety of network interfaces. Due to a large number of potential properties to check, the verification framework needs to support efficient formulation of properties with a suitable Domain Specific Language (DSL). Our approach is to utilize a distributed system that is geared towards connectivity and scalability and interface it at the message queue level to a powerful verification engine. We implemented our approach in the tool called MESA: Message-Based System Analysis, which leverages the open source projects RACE (Runtime for Airspace Concept Evaluation) and TraceContract. RACE is a platform for instantiating and running highly concurrent and distributed systems and enables connectivity to SWIM and scalability. TraceContract is a runtime verication tool that allows for checking traces against properties specified in a powerful DSL. We applied our approach to verify a SWIM service against several requirements.We found errors such as duplicate and out-of-order messages.

Message-based System↗

Culture-Independent Microbial Air Profiling using a Spaceflight-Compatible Nanopore Sequencing Method

Microbial monitoring of spacecraft air is critical toward assessing the efficacy of microbial controls within the environmental control and life support systems to protect both the crew and the vehicle environment. Additionally, understanding of the atmospheric microbial profiles will be essential toward Mars-forward planetary protection planning. Currently, onboard the International Space Station (ISS), the air is monitored on a quarterly basis using an impaction air sampler. With this method, bacterial and fungal cells and spores are pulled onto plates containing growth medium. Following five days of ambient incubation onboard the ISS, the crew compares the growth to density charts and provides the approximations to the ground. Upon return of the culture plates to the Johnson Space Center’s Microbiology Laboratory, the isolates present are identified for crew health risk assessments. As NASA moves beyond the low-Earth orbit of ISS, sample return will be impractical. As such, a near real-time monitoring capability for the assessment of the spacecraft atmosphere is necessary. Significant strides have been made in recent years to utilize a molecular-based method for microbial profiling of ISS surfaces. The developed method is not dependent on microbial culture, thus removing the associated risk to the crew from high microbial levels, the bias toward detecting only the culturable organisms, and eliminates the need for sample return. The work described here details the evaluation of three different air sampling platforms whose product is amenable to downstream molecular processing and nanopore sequencing. The three samplers were compared in terms of mass and power requirements, ease-of -use, and the resulting data. For the two highest ranking samplers, a basic concept of operations was developed to transfer the sample into the already established preparation and sequencing process. Using these concepts of operations, an in-depth comparison of the molecular data generated was compared to the historical culture-based method. Data from both methods detailed similar microbial profiles, while the molecular method detailed microbial identifications that could not be identified through the culture-based method. The developed method will enable the generation of near real-time microbial profiles of the spacecraft atmosphere.

Brandon J Dunbar↗

Culture-Independent Microbial Air Profiling using a Spaceflight-Compatible Nanopore Sequencing Method

Microbial monitoring of spacecraft air is critical toward assessing the efficacy of microbial controls within the environmental control and life support systems to protect the crew and vehicle environment. Currently, onboard the International Space Station (ISS), the air is monitored every quarter using an impaction air sampler. With this method, microbial cells and spores are pulled onto plates containing a growth medium. Following onboard incubation, the crew reports approximate microbial levels to the ground, but sample return is required for identification. Upon return of the plates, the isolates present are identified for crew health risk assessments. As NASA moves beyond low-Earth orbit, sample return will be impractical, and a near real-time monitoring capability is essential. Significant strides have been made in recent years to utilize a molecular-based method for microbial profiling of ISS surfaces. The developed method is independent of microbial culture, thus removing the bias toward detecting only culturable organisms, eliminating the need for sample return, and reducing the risk to crew health from exposure to high microbial levels. The work described here details the evaluation of three different air sampling platforms whose product is amenable to downstream molecular processing. The three samplers were compared in terms of mass and power requirements, ease of use, and the resulting data. For the two highest-ranking samplers, a basic concept of operations was developed to transfer the sample into the already established preparation and sequencing process. Using these concepts of operations, an in-depth comparison of the molecular data generated was compared to the historical culture-based method. Data from both methods detailed similar microbial profiles, while the molecular method detailed microbial identifications that were lacking from the culture data. The developed method will enable the generation of near real-time microbial profiles of the spacecraft atmosphere.

Brandon Dunbar↗

Modeling and Simulation of Automated Mobility Districts

Connected and automated vehicles (CAVs) are increasingly being discussed as the basis for shared mobility and on-demand services to replace privately owned vehicles. The rapid growth of Transportation Networking Companies (TNCs) and their increasing investment in automated vehicle (AV) technologies attests to this. Combining the concepts of TNCs, with AVs and on-demand transit services, the term 'automated mobility district' (AMD) describes a district-scale implementation of CAV technology to realize the full benefits of a shared, fully automated vehicle service within a confined region. This research effort provides a modeling architecture for AMDs along with a preliminary analysis to quantify the mobility and energy benefits of such districts. A customized open-source microscopic mobility simulation toolkit built on the Simulation of Urban Mobility (SUMO) platform is implemented for AMD performance evaluation. Experimental scenarios are tested with different combinations of operational variables to provide insights on energy and mobility gains that can be realized in AMDs.

33 ADVANCED PROPULSION SYSTEMS↗

Quantifying the Mobility and Energy Benefits of Automated Mobility Districts Using Microscopic Traffic Simulation

Connected and automated vehicles (CAVs) are increasingly being discussed as the basis for shared mobility and on-demand services to replace privately owned vehicles. The rapid growth of transportation networking companies (TNCs) and their increasing investment in automated vehicle (AV) technologies attests to this. Combining the concepts of TNCs, with AV and on-demand transit services, the term “automated mobility district” (AMD) describes a district-scale implementation of CAV technology to realize the full benefits of a shared, fully automated vehicle service within a confined region. This research effort provides a modeling architecture for AMDs along with a preliminary analysis to quantify the mobility and energy benefits of such districts. A customized open-source microscopic mobility simulation toolkit built on the simulation of urban mobility (SUMO) platform is implemented for AMD performance evaluation. Experimental scenarios are tested with different combinations of operational variables to provide insights on energy and mobility gains that can be realized in AMDs.

Zhu, Lei↗

BRAINSTACK – A Platform for Artificial Intelligence & Machine Learning Collaborative Experiments on a Nano-Satellite

As space missions continue to become more ambitious, complex, and distant to Earth, the need for advanced on-board intelligent decision making to guide everything from mission operations to fault detection and recovery has become a major front of space research. While the prevalence of research on such Artificial Intelligence / Machine Learning (AI/ML) modules has exploded, the capacity to experimentally validate such modules in space in a rapid and inexpensive format has not. To this end, the Nano Orbital Workshop (NOW) group at NASA Ames Research Center has been at the forefront of performing initial flight evaluation tests of ‘commercially’ available AI/ML computational platforms via the TechEdSat (TES-n) flight series as part of what is programmatically referred to as the BRAINSTACK. BRAINSTACK will provide an orbital AI/ML evaluation laboratory where computational experiments are pre-loaded into memory prior to launch, and then executed as desired during the mission, with results reported back and program tweaks or new data sets uploaded as needed. Processors selected as part of the BRAINSTACK are of ideal size, packaging, and power consumption for easy integration into a cube satellite structure. These experiments have included the evaluation of small, high-performance GPUs and more recently, neuromorphic processors in LEO operations. Neuromorphic processors are of particular interest due to their superior computational power efficiency over GPUs. The first TES-n flight test of an Intel first-generation Loihi neuromorphic processor launched on January 13, 2022 and continues to operate in orbit despite almost no space environment modifications. The Intel Loihi Gen-1 is characterized by a 14nm 128-core Spiking Neural Network (SNN) able to support on-chip training. This experiment utilized a Loihi packaged in the ‘Kapoho Bay’ USB module, providing a relatively straight-forward interface to the bus avionics system. The Kapoho Bay was in turn managed by a host Intel Pentium single-board computer to handle scheduling of the AI/ML application payloads, and communications with the satellite vehicle manager. The recently released Intel Loihi Gen-2, able to support integer-valued spike payloads and produced using 7nm process, will form part of the basis of the evolving BRAINSTACK in the upcoming three TES-n/NOW flights. Additionally, it is planned to measure the radiation environment these processors experience to understand any degradation or computational artifacts caused by long term space radiation exposure on these novel architectures. This evolving flexible and collaborative environment involving various research teams across NASA and other organizations is intended to be a convenient orbital test platform from which many anticipated future space AI/ML applications may be initially tested.

Artificial Intelligence↗

BRAINSTACK – A Platform for Artificial Intelligence & Machine Learning Collaborative Experiments on a Nano-Satellite

As space missions continue to become more ambitious, complex, and distant to Earth, the need for advanced on-board intelligent decision making to guide everything from mission operations to fault detection and recovery has become a major front of space research. While the prevalence of research on such Artificial Intelligence / Machine Learning (AI/ML) modules has exploded, the capacity to experimentally validate such modules in space in a rapid and inexpensive format has not. To this end, the Nano Orbital Workshop (NOW) group at NASA Ames Research Center has been at the forefront of performing initial flight evaluation tests of ‘commercially’ available AI/ML computational platforms via the TechEdSat (TES-n) flight series as part of what is programmatically referred to as the BRAINSTACK. BRAINSTACK will provide an orbital AI/ML evaluation laboratory where computational experiments are pre-loaded into memory prior to launch, and then executed as desired during the mission, with results reported back and program tweaks or new data sets uploaded as needed. Processors selected as part of the BRAINSTACK are of ideal size, packaging, and power consumption for easy integration into a cube satellite structure. These experiments have included the evaluation of small, high-performance GPUs and more recently, neuromorphic processors in LEO operations. Neuromorphic processors are of particular interest due to their superior computational power efficiency over GPUs. The first TES-n flight test of an Intel first-generation Loihi neuromorphic processor launched on January 13, 2022 and continues to operate in orbit despite almost no space environment modifications. The Intel Loihi Gen-1 is characterized by a 14nm 128-core Spiking Neural Network (SNN) able to support on-chip training. This experiment utilized a Loihi packaged in the ‘Kapoho Bay’ USB module, providing a relatively straight-forward interface to the bus avionics system. The Kapoho Bay was in turn managed by a host Intel Pentium single-board computer to handle scheduling of the AI/ML application payloads, and communications with the satellite vehicle manager. The recently released Intel Loihi Gen-2, able to support integer-valued spike payloads and produced using 7nm process, will form part of the basis of the evolving BRAINSTACK in the upcoming three TES-n/NOW flights. Additionally, it is planned to measure the radiation environment these processors experience to understand any degradation or computational artifacts caused by long term space radiation exposure on these novel architectures. This evolving flexible and collaborative environment involving various research teams across NASA and other organizations is intended to be a convenient orbital test platform from which many anticipated future space AI/ML applications may be initially tested.

Artificial Intelligence↗

Demonstrating Advanced Sensors for In-Situ Monitoring Towards Qualification of Nuclear Relevant Components

The U.S. Department of Energy’s Office of Nuclear Energy Advanced Materials and Manufacturing Technologies (AMMT) program is pursuing qualification of laser powder bed fusion (LPBF) components for nuclear applications. A major focus of this effort is the use of in situ process monitoring and machine learning–based tools to establish real-time quality assurance. The primary objective of this report is to identify and evaluate the most relevant in situ sensor systems for LPBF, and to document the deployment of these systems across platforms critical to the AMMT program. This work demonstrates how in situ monitoring can detect process anomalies, track geometry-dependent flaws, and identify limiting combinations of processing parameters—particularly those related to energy density and complex geometries (e.g., overhanging structures). To support this goal, a diverse suite of sensor modalities was evaluated across LPBF platforms, including visible and near-infrared (NIR) imaging, fringe projection profilometry, long-wavelength infrared (LWIR) thermography, and high-speed photodiode/pyrometry systems. These sensor streams were integrated with Peregrine, a machine-agnostic software platform that, among other capabilities, can generate real-time process anomaly classification. This report documents sensor deployments on multiple AMMT flagship platforms, including the Concept Laser M2 and Renishaw AM400/AM250 systems. Calibration builds with complex, flaw-prone geometries such as unsupported overhangs, stepped features, and thin walls, were used to evaluate how well Peregrine and its associated sensors could detect process anomalies and other instabilities under varied energy densities. It will be shown how Peregrine reliably identifies common process anomalies such as recoater streaking, superelevation, etc., and can be used in post-build analysis for anomaly spatial distributions throughout the build height to better understand the impact of geometry and processing parameter choice on the build. This work demonstrates measurable progress toward the vision that components can be born-qualified by establishing a real-time monitoring framework, identifying limiting process conditions, and laying the foundation for sensor fusion–enabled prediction pipelines that are scalable across platforms and applicable to nuclear-relevant components.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Simulating the ARES Aircraft in the Mars Environment

NASA Langley proposed the Aerial Regional-scale Environmental Survey (ARES) of Mars science mission in response to the NASA Office of Space Science 2002 Mars Scout Opportunity. The science-driven mission proposal began with trade studies and determined that a rocket powered aircraft was the best suited platform to complete the ARES science objectives. A high fidelity six degree of freedom flight simulation was required to provide credible evidence that the aircraft design fulfilled mission objectives and to support the aircraft design process by providing performance evaluations. The aircraft was initially modeled using the aero, propulsion, and flight control system components of other aircraft models. As the proposed aircraft design evolved, the borrowed components were replaced with new models. This allowed performance evaluations to be performed as the design was maturing. Basic autopilot features were also developed for the ARES aircraft model. Altitude hold and track hold modes allowed different mission scenarios to be evaluated for both science merit and aircraft performance. Platform stability and data rate requirements were identified for each of the instruments and the aircraft performance was evaluated against those requirements. The results of the simulation evaluations indicate that the ARES design and mission profiles are sound and meet the science objectives.

Kenney, P. Sean↗

Geostationary platform systems concepts definition study. Volume 2: Technical, book 3

The supporting research and technology, and space demonstrations required to support the 1990s operational geostationary platforms are identified. Also the requirements on and interfaces with the Space Transportation System hardware elements supporting the geostationary platform program, including the shuttle, orbital transfer vehicles, teleoperator, etc., are investigated to provide integrated support requirements. Finally, a preliminary evaluation of the practicability and capabilities of an experimental platform from the standpoint of technology, schedule, and cost is given.

Source record↗

Early Evaluation of Fugaku A64FX Architecture Using Climate Workloads

The Energy Exascale Earth System Model (E3SM) Project is an ongoing, state-of-the-science Earth system modeling, simulation, and prediction project that targets efficient utilization of U.S. Department of Energy’s (DOE) supercomputers to meet the science needs of the nation and the mission needs of DOE. This work focuses on our early evaluation of the A64FX architecture on Fugaku supercomputer using E3SM benchmarks. We will present results that track hardware trends, facilitate architecture comparison and the specific impact on our workload using an atmospheric model benchmark. We have two variants of the code written in Fortran and C++/Kokkos respectively which were used to collect data on a variety of CPU and GPU platforms. Furthermore, we have conducted a comparative evaluation of the compilers on the A64FX architecture and found GNU to be the best performer for our workload. Our experience so far indicates that Fugaku/A64FX shows promising energy efficiency (performance/Watt) with further performance gains possible through architecture-aware optimization efforts.

Sreepathi, Sarat↗

Design Studies for Deep-Water Floating Offshore Vertical Axis Wind Turbines

Deep-water offshore sites are an untapped opportunity to bring large-scale offshore wind energy to coastal population centers. The primary challenge has been the projected high costs for floating offshore wind systems. This work presents a comprehensive investigation of a new opportunity for deep-water offshore wind using large-scale vertical axis wind turbines. Owing to inherent features of this technology, there is a potential transformational opportunity to address the major cost drivers for floating wind using vertical axis wind turbines. The focus of this report is to evaluate the technical potential for this new technology. The approach to evaluating this potential was to perform system design studies focused on improving the understanding of technical performance parameters while looking for cost reduction opportunities. VAWT design codes were developed in order to perform these design studies. To gain a better understanding of the design space for floating VAWT systems, a comprehensive design study of multiple rotor configuration options was carried out. Floating platforms and moorings were then sized and evaluated for each of the candidate rotor configurations. Preliminary LCOE estimates and LCOE ranges were produced based on the design study results for each of the major turbine and system components. The major outcomes of this study are a comprehensive technology assessment of VAWT performance and preliminary LCOE estimates that demonstrate that floating VAWTs may have favorable performance and costs in comparison to conventional HAWTs in the deep-water offshore environment where floating systems are required, indicating that this new technology warrants further study.

17 WIND ENERGY↗

Monitoring physical and chemical parameters of Delaware Bay waters with an ERTS-1 data collection platform

The author has identified the following significant results. Evaluation of the probe performances during the initial phase indicates that the dissolved oxygen sensor available as part of the package is not sufficiently reliable for long term operation. The turbidity probe requires frequent visits to the site to maintain it in proper operating condition. The cost of these visits would have to be weighed against the information obtained. The conductivity/salinity, temperature, pH, and depth indicators have worked extremely well over the course of the study. Monthly cleanings would maintain all these probes in top operating condition. Currently the accuracy of each measurement returned via satellite is being compared to the accuracy of the probe reading and water samples analyzed in the laboratory.

Klemas, V.↗

Use of the Manuela 3D/Radiation Scanning Tool at Nuclear Facilities - 20437

Licensees, facility operators and decommissioning contractors have a need for comprehensive, accurate and precise radiological and topographical data to plan and execute safe and efficient Decontamination and Decommissioning (D and D) projects. Traditional approaches rely greatly upon labor and administratively intensive data collection methods that require considerable time and effort to glean the relevant data to plan and perform work in a radiological work area. Orano Decommissioning Services has developed and utilized at French nuclear facilities a lightweight portable scanning instrument called MANUELA (Mobile Apparatus for Nuclear Expertise Localization Assistance). Recently Orano conducted demonstrations at two United States nuclear facilities using MANUELA that may prove useful in areas of the fuel cycle including: - ALARA (As Low As Reasonably Achievable) planning during facility operations; - Scoping and site characterization during the D and D planning phase; - Remedial action support during active decommissioning work; - Radiation and modeling planning for plant modifications; - Support Final Status Survey and demonstration of 'end state' compliance for license termination. MANUELA is currently being evaluated for use during decommissioning of nuclear facilities and could aide in demonstrating compliance with end state criteria after decommissioning. Of particular interest are decommissioning projects planned for various sites across the United States. Most of these sites present unique challenges and opportunities to safely and efficiently decommission in a regulatory compliant manner. The two demonstration site's current conditions of relatively low radiation levels inside containment proved to be ideal platforms to deploy the MANUELA instrument for evaluation of the complex geometries typically found in a nuclear facility. The MANUELA instrument was able to precisely identify local hot spots of the reactor system's primary equipment and was able to simultaneously overlay the dose information onto the scanned 3D images. Using data like this, a licensee would be able to make informed technical and personnel decisions on methods to remediate, shield or properly dispose of the radioactive source term. MANUELA can be used throughout the decommissioning process to validate progress and continue to refine the work activities to optimize the efforts of the crew which reduces downtime waiting for survey results, whereas traditional survey methodology relies on a physical survey to be performed and the data transcribed onto survey maps that are only two dimensional. The traditional format tends to be inaccurate and difficult to interpret the precise location(s) of hot spots or generalized dose rates. The resultant scan also allows the user to know the exact extent of the survey versus transposing information onto a map with only a portion of the map area scanned. MANUELA also compiles all of the relevant survey data into a downloadable table format which includes the measurement identification number, time stamp, point space location on the XYZ plane, and the dose rate value. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational demands of these complex models pose significant challenges, requiring efficient hardware acceleration. Benchmarking the performance of LLMs across diverse hardware platforms is crucial to understanding their scalability and throughput characteristics. We introduce LLM-Inference-Bench, a comprehensive benchmarking suite to evaluate the hardware inference performance of LLMs. We thoroughly analyze diverse hardware platforms, including GPUs from Nvidia and AMD and specialized AI accelerators, Intel Habana and SambaNova. Our evaluation includes several LLM inference frameworks and models from LLaMA, Mistral, and Qwen families with 7B and 70B parameters. Our benchmarking results reveal the strengths and limitations of various models, hardware platforms, and inference frameworks. We provide an interactive dashboard to help identify configurations for optimal performance for a given hardware platform.

Chitty-Venkata, Krishna Teja↗

Preliminary Dynamic Feasibility and Analysis of a Spherical, Wind-Driven (Tumbleweed), Martian Rover

The process and findings are presented from a preliminary feasibility study examining the dynamics characteristics of a spherical wind-driven (or Tumbleweed) rover, which is intended for exploration of the Martian surface. The results of an initial feasibility study involving several worst-case mobility situations that a Tumbleweed rover might encounter on the surface of Mars are discussed. Additional topics include the evaluation of several commercially available analysis software packages that were examined as possible platforms for the development of a Monte Carlo Tumbleweed mission simulation tool. This evaluation lead to the development of the Mars Tumbleweed Monte Carlo Simulator (or Tumbleweed Simulator) using the Vortex physics software package from CM-Labs, Inc. Discussions regarding the development and evaluation of the Tumbleweed Simulator, as well as the results of a preliminary analysis using the tool are also presented. Finally, a brief conclusions section is presented.

Flick, John J.↗

New Air-Launched Small Missile (ALSM) Flight Testbed for Hypersonic Systems

The Phoenix Air-Launched Small Missile (ALSM) flight testbed was conceived and is proposed to help address the lack of quick-turnaround and cost-effective hypersonic flight research capabilities. The Phoenix ALSM testbed results from utilization of the United States Navy Phoenix AIM-54 (Hughes Aircraft Company, now Raytheon Company, Waltham, Massachusetts) long-range, guided air-to-air missile and the National Aeronautics and Space Administration (NASA) Dryden Flight Research Center (Edwards, California) F-15B (McDonnell Douglas, now the Boeing Company, Chicago, Illinois) testbed airplane. The retirement of the Phoenix AIM-54 missiles from fleet operation has presented an opportunity for converting this flight asset into a new flight testbed. This cost-effective new platform will fill the gap in the test and evaluation of hypersonic systems for flight Mach numbers ranging from 3 to 5. Preliminary studies indicate that the Phoenix missile is a highly capable platform; when launched from a high-performance airplane, the guided Phoenix missile can boost research payloads to low hypersonic Mach numbers, enabling flight research in the supersonic-to-hypersonic transitional flight envelope. Experience gained from developing and operating the Phoenix ALSM testbed will assist the development and operation of future higher-performance ALSM flight testbeds as well as responsive microsatellite-small-payload air-launched space boosters.

Bui, Trong T.↗