Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Systems Engineering and Analysis in Support of a US Federal Staging Facility for UNF

The US Department of Energy Office of Nuclear Energy (DOE-NE) Office of Spent Fuel and High-Level Waste Disposition is examining a set of system options and conducting supporting analyses to inform the development of an integrated waste management system, which may include one or more federal staging facilities (FSFs) for used nuclear fuel (UNF ) sited using a collaborative siting process. This paper focuses on the ongoing activities in two systems engineering and analysis work areas: (1) data and tools development, validation, and maintenance and (2) systems engineering execution. Within the first work area, the STANDARDS 5.0 UNF data and analysis tool, formerly known as UNF-ST&DARDS, is being developed as a foundational resource to assist in the management of UNF data. It has the key capability to model UNF throughout the entire back end of the fuel cycle. STANDARDS also includes several compatible analysis tools for the time-dependent characterization of UNF and related systems by interfacing with the SCALE code system for nuclear analysis and COBRA-SFS for thermal analysis. Also, within the data and tools area is the Next Generation System Analysis Model (NGSAM), which is an agent-based simulation software tool expressly designed to be capable of modeling the waste management system, including the transportation of UNF to and from a FSF. NGSAM has been developed to enable informed decision-making by providing the capability to analyze various potential system options for the management of UNF and high-level radioactive waste. Finally, in the systems engineering execution area, the team has begun to apply a disciplined systems engineering approach at the system level along with supporting analysis to guide the development of the FSF project requirements (including associated transportation infrastructure). Systems engineering principles and practices and their adaptation/application to design and development activities will ensure that the waste management system is effectively implemented as work proceeds. Other activities include investigating the implications of changes in various assumptions and parameters related to waste management systems, such as UNF acceptance rates, receipt logic, facility capacities and capabilities, use of standardized canisters, and different assumed facility operation start dates. Keywords: federal staging facility (FSF), used nuclear fuel (UNF), integrated waste management (IWM) system, Next Generation System Analysis Model (NGSAM), STANDARDS, systems engineering

Joseph, Robert↗

Upgrading Biogas through in situ Conversion of Carbon Dioxide to Biomethane in Anaerobic Digesters

Organic waste streams generated by wastewater treatment plants, agricultural operations, and food processing industries represent an important yet underutilized opportunity for renewable energy production in the United States. Through anaerobic digestion, these waste streams can produce biogas, a mixture primarily composed of methane (CH4) and carbon dioxide (CO2), that can be upgraded to pipeline-quality natural gas. However, most existing upgrading technologies remove CO2 from biogas rather than utilizing it, leaving a significant portion of the potential energy unused. This project investigates a novel biological upgrading approach that converts CO2 into additional CH4 by supplying hydrogen (H2) to specialized microorganisms capable of performing hydrogenotrophic methanation. The main challenges associated with biological biogas upgrading are related to hydrogen supply, gas-liquid mass transfer, and process stability. First, due to the high cost of hydrogen gas, it is preferable that H2 be produced on-site using renewable energy sources such as wind or solar power. Second, hydrogen has low solubility in liquids, which limits its availability to microorganisms and requires strategies to improve gas dissolution and transfer within the reactor. Third, process inhibition may occur as a result of increased pH caused by CO2 consumption or elevated H2 partial pressure, both of which can negatively affect methanogenic activity. Although research in these areas has advanced during the course of this project, these challenges have not yet been fully resolved. To date, the biological systems that have achieved the highest methane concentrations are typically ex-situ reactors, where operational conditions can be more easily controlled. For this reason, the findings of the present project remain highly relevant. The project goal was to develop an innovative system that can accomplish biogas upgrading via biological conversion of CO2 to CH4, in a novel hybrid approach that combines the advantages of both in-situ and ex-situ systems. The proposed system employs a three-phase upflow anaerobic bioreactor with H2 delivery through a gas-permeable membrane, enabling efficient hydrogen transfer and microbial conversion. Under optimized operating conditions, the system achieved 99% H2 consumption and 90% CO2 conversion. A subsequent gas cleaning stage was implemented to further improve gas quality and meet target purity standards. The upgraded gas composition reached 97.7% CH4, 2.2% CO2, and 0.97% O2, while H2S concentrations remained below detection limits. In addition, a flue gas-driven inorganic thermoelectric generator (TEG) system was designed and experimentally validated as a potential source of electricity for H2 production. The system consisted of six TEG modules connected in series and achieved an open-circuit voltage of 4.5 V and a maximum power output of 224 mW at a temperature difference of approximately 53.5 °C, demonstrating effective conversion of waste heat into electrical power under simulated flue gas conditions. Finally, a comprehensive techno-economic analysis was completed to evaluate the capital and operating costs associated with the proposed system. The results provide important insights to guide future scale-up, optimization, and potential deployment of integrated biological biogas upgrading technologies.

09 BIOMASS FUELS↗

Improving Human/Autonomous System Teaming Through Linguistic Analysis

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such integration requires humans to work closely with autonomous systems, forming human and autonomous agent teams. The intention behind such teaming is that a team composed of both humans and autonomous agents will operate better than homogenous teams. Procedures exist for licensing pilots to operate in the national airspace system and current work is being done to define methods for validating the function of autonomous systems, however there is no method in place for assessing the interaction of these two disparate systems. Moreover, currently these systems are operated primarily by subject matter experts, limiting their use and the benefits of such teams. Providing additional information about the ongoing mission to the operator can lead to increased usability and allow for operation by non-experts. Linguistic analysis of the context of verbal communication provides insight into the intended meaning of commonly heard phrases such as "What's it doing now?" Analyzing the semantic sphere surrounding these common phrases enables the prediction of the operator's intent and allows the interface to supply the operator's desired information.

Meszaros, Erica L.↗

Differential Adaptive Stress Testing of Airborne Collision Avoidance Systems

The next-generation Airborne Collision Avoidance System (ACAS X) is currently being developed and tested to replace the Traffic Alert and Collision Avoidance System (TCAS) as the next international standard for collision avoidance. To validate the safety of the system, stress testing in simulation is one of several approaches for analyzing near mid-air collisions (NMACs). Understanding how NMACs can occur is important for characterizing risk and informingdevelopment of the system. Recently, adaptive stress testing (AST) has been proposed as a way to find the most likely path to a failure event. The simulation-based approach accelerates search by formulating stress testing as a sequential decision process then optimizing it using reinforcement learning. The approach has been successfully applied to stress test a prototype of ACAS Xin various simulated aircraft encounters. In some applications, we are not as interestedin the system's absolute performance as its performance relative to another system. Such situations arise, for example, during regression testing or when deciding whether a new system should replace an existing system. In our collision avoidance application, we are interested in finding cases where ACAS X fails but TCAS succeeds in resolving a conflict. Existing approaches do not provide an efficient means to perform this type of analysis. This paper extends the AST approach to differential analysis by searching two simulators simultaneously and maximizing the difference between their outcomes. We call this approach differential adaptive stress testing (DAST). We apply DAST to compare a prototype of ACAS X against TCAS and show examples of encounters found by the algorithm.

Lee, Ritchie↗

Lessons Learned From the Flight of the NASA In-Step Cryo System Experiment

The Cryo System Experiment was developed to validate in near zero-g space a 65 K cryogenic system for focal planes, optics, or other imaging instruments that require continuous cryogenic cooling. Two key cryogenic technologies, designed to improve performance of systems for scientific, commercial and defense applications in space, were successfully demonstrated on a February 1995 Shuttle mission. The two were a 2-watt 65 K long-life low- vibration Stirling cooler and a diode oxygen heat pipe thermal switch. Lessons learned are presented.

cryogenics↗

MERIT - A new approach to upper air forecasting for aviation

The development of a man/computer data enhancement and management system to provide very-short range upper air forecasts is examined. The forecast accuracy and precision problems encountered with the current numerical weather prediction models are discussed. The proposed system is to utilize both radiosonde data and automated pilot reports and provide a 2-12 hour analysis/forecast with a 3 hour forecast cycle. The minimum energy routes using interactive techniques (MERIT) system is described and a diagram is povided. The preliminary testing of a modified MERIT system reveals that the system is not as accurate as the Spectral 12 hour forecast, but is more accurate than the spectral 24 hour forecast. The coplete testing and validation of the MERIT system is required before a comparison with present techniques is possible.

Steinberg, R.↗

Architecture for Payload Planning System (PPS) Software Distribution

The complex and diverse nature of the pay load operations to be performed on the Space Station requires a robust and flexible planning approach, and the proper software tools which tools to support that approach. To date, the planning software for most manned operations in space has been utilized in a centralized planning environment. Centralized planning is characterized by the following: performed by a small team of people, performed at a single location, and performed using single-user planning systems. This approach, while valid for short duration flights, is not conducive to the long duration and highly distributed payload operations environment of the Space Station. The Payload Planning System (PPS) is being designed specifically to support the planning needs of the large number of geographically distributed users of the Space Station. This paper problem provides a general description of the distributed planning architecture that PPS must support and describes the concepts proposed for making PPS available to the Space Station payload user community.

Howell, Eric↗

Software IV and V Research Priorities and Applied Program Accomplishments Within NASA

The mission of this research is to be world-class creators and facilitators of innovative, intelligent, high performance, reliable information technologies that enable NASA missions to (1) increase software safety and quality through error avoidance, early detection and resolution of errors, by utilizing and applying empirically based software engineering best practices; (2) ensure customer software risks are identified and/or that requirements are met and/or exceeded; (3) research, develop, apply, verify, and publish software technologies for competitive advantage and the advancement of science; and (4) facilitate the transfer of science and engineering data, methods, and practices to NASA, educational institutions, state agencies, and commercial organizations. The goals are to become a national Center Of Excellence (COE) in software and system independent verification and validation, and to become an international leading force in the field of software engineering for improving the safety, quality, reliability, and cost performance of software systems. This project addresses the following problems: Ensure safety of NASA missions, ensure requirements are met, minimize programmatic and technological risks of software development and operations, improve software quality, reduce costs and time to delivery, and improve the science of software engineering

Blazy, Louis J.↗

Power Analysis of an ePump Applied to the Linear Functions of an Agricultural Planter

Like many other industries, the agricultural industry has recently ex-perienced pressure to reduce vehicle emissions while improving productivity. Electric actuation is perceived as a viable solution to replace or augment hydrau-lic and mechanical actuation. However, electrification presents challenges with regards to linear functions, where hydraulic actuators have advantages in terms of compactness, tolerance to contamination and resistance to shocks. A combined electro-hydraulic actuation architecture can leverage the benefits of both electric and hydraulic actuation, while reducing the drawbacks of both approaches. This work investigates the potential of a centralized electric driven pump (ePump) system powering the pressure-controlled linear functions of an agricul-tural planter, with the goal of improving the operating point of the main supply pump. In this application, the rotary functions are hydraulically actuated, alt-hough such a solution could be applied also to electric rotary actuation. This is accomplished by setting the ePump to boost the pressure supplied by the tractor to the level required by the linear functions. An accumulator is used to stabilize the flow requirements of the linear functions, and control the pressure supplied to the actuators. Two control schemes are proposed for the regulation of the ac-cumulator pressure, one favoring an efficient operating point for the ePump, the other favoring stable steady state operation. A simulation model of the baseline system and proposed system is developed and validated using experimental data from a full-scale machine. Using the vali-dated simulation, both control architectures are then evaluated for improvement in system power consumption and dynamic requirements on the ePump to assess their effectiveness. Both systems demonstrate significant improvement in power consumption over the baseline system, with the best solution improving effi-ciency by 64%.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Airspace Safety Threshold Study: Status Update to SC-228 DAA Safety Sub-Group

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228, is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. A recent study conducted using NASA's ACES (Airspace Concept Evaluation System) simulation capability begins to address questions surrounding the development of draft MOPS for DAA systems. ACES analyses were conducted to determine: 1) the rate at which IFR aircraft encounter other IFR and VFR aircraft, and 2) the rate at which UAS aircraft encounter VFR aircraft. Five different separation thresholds were used (two for encounter and one each for well-clear, near mid-air collision, and closest point of approach). The results will be used by SC228 to inform decisions about the safety aspect of UAS DAA systems and future requirements development and validation efforts.

Risk ratio↗

Trusted Communication: Utilizing Speech Communication to Enhance Human-Machine Teaming Success

An area of increasing interest for the next generation of aircraft is autonomy and the integration of increasingly autonomous systems into the national airspace. Such an integration requires humans to work closely with autonomous systems, forming teams. Our hypothesis is that a team composed of both humans and autonomous systems will operate better than either entity alone. We have existing procedures for certifying pilots to operate in the national airspace and are currently working on methods for validating the function of autonomous systems, however we have no method in place for assessing the interaction of these two disparate systems. Communication is one avenue. This paper will examine the use of language as a metric for ascertaining human-machine teaming effectiveness. A proof-of-concept of the application of two communication-based analysis techniques, Linguistic Inquiry and Word Count (LIWC) and Latent Semantic Analysis (LSA), for the prediction of success in human/chatbot teaming was conducted. By running these analyses over data from the 2014 and 2015 Loebner Prize competitions of human/chatbot teaming, numerical scores were obtained that can be associated with scores provided by human judges during the competition. Correlating their LIWC and LSA data with the scores provided by the judges, and using linear regression over this correlation, formulae were obtained that predict the score of human/chatbot interaction. These formulae were tested over the 2013 Loebner Prize transcripts, determining that, though there was strong correlation between predicted and actual scores, the predictive success of this method was not strong. However, with specialized topic spaces and lexica, as well as larger data sets, the predictive power of these metrics will improve. Given the importance of providing metrics for human-machine system team success and given the promise shown by the communication-basedLIWCand LSAmethods, continuing research in this area is necessary. After examining the potential for using communication and spoken language as a metric for the success of human/autonomous system teaming, this paper then examines aspects inherent to communication systems that may contribute to unreliability and reduced trust. Modern natural language processing tools rely on deep learning algorithms to create language rules that produce accurate results, but these rules are uninterpretable. The resulting blackbox system lacks transparency necessary for full validation and complete trust. Additionally, speech-based interfaces pose other difficulties to developing coordinated teamwork between humans and autonomous systems. Human communication is infrequently limited to speech only, instead usually relying on a combination of verbal, gestural, and general body language communication. Reducing an analysis of team effectiveness to a study of spoken language alone is problematic as it leaves these other equally important forms of communication out. This paper will examine these problems and the general deficiencies in speech-based metrics for human-machine teaming.

E L Meszaros↗

A Benchmark Case for the Grid Survivability Analysis

Among current priorities of the power system analysis is the development of metrics and computational tools for the resilience analysis during catastrophic events. New methods and tools are required for such an analysis and they have to be validated prior application to real systems. However, benchmark problems are not readily available due to the analysis novelty. The current paper presents a case based on the IEEE 14-bus system for this purpose. The grid is simplified to a graph with nodes representing generators, loads, and buses. Power inputs are imported from real-time simulations of the IEEE 14-bus system. Outcomes of all possible combinations of failed elements are presented in terms of probabilities for the grid to survive, partially survive, or fail. Only the power grid's ability to withstand adverse events (survivability) is analyzed. The grid's recoverability, the other part of the resilience analysis, is not considered.

power system↗

Fault-tolerant clock synchronization validation methodology

A validation method for the synchronization subsystem of a fault-tolerant computer system is presented. The high reliability requirement of flight-crucial systems precludes the use of most traditional validation methods. The method presented utilizes formal design proof to uncover design and coding errors and experimentation to validate the assumptions of the design proof. The experimental method is described and illustrated by validating the clock synchronization system of the Software Implemented Fault Tolerance computer. The design proof of the algorithm includes a theorem that defines the maximum skew between any two nonfaulty clocks in the system in terms of specific system parameters. Most of these parameters are deterministic. One crucial parameter is the upper bound on the clock read error, which is stochastic. The probability that this upper bound is exceeded is calculated from data obtained by the measurement of system parameters. This probability is then included in a detailed reliability analysis of the system.

Computer systems↗

Flight Test 4 Preliminary Results: NASA Ames SSI

Realization of the expected proliferation of Unmanned Aircraft System (UAS) operations in the National Airspace System (NAS) depends on the development and validation of performance standards for UAS Detect and Avoid (DAA) Systems. The RTCA Special Committee 228 is charged with leading the development of draft Minimum Operational Performance Standards (MOPS) for UAS DAA Systems. NASA, as a participating member of RTCA SC-228 is committed to supporting the development and validation of draft requirements as well as the safety substantiation and end-to-end assessment of DAA system performance. The Unmanned Aircraft System (UAS) Integration into the National Airspace System (NAS) Project conducted flight test program, referred to as Flight Test 4, at Armstrong Flight Research Center from April -June 2016. Part of the test flights were dedicated to the NASA Ames-developed Detect and Avoid (DAA) System referred to as JADEM (Java Architecture for DAA Extensibility and Modeling). The encounter scenarios, which involved NASA's Ikhana UAS and a manned intruder aircraft, were designed to collect data on DAA system performance in real-world conditions and uncertainties with four different surveillance sensor systems. Flight test 4 has four objectives: (1) validate DAA requirements in stressing cases that drive MOPS requirements, including: high-speed cooperative intruder, low-speed non-cooperative intruder, high vertical closure rate encounter, and Mode CS-only intruder (i.e. without ADS-B), (2) validate TCASDAA alerting and guidance interoperability concept in the presence of realistic sensor, tracking and navigational errors and in multiple-intruder encounters against both cooperative and non-cooperative intruders, (3) validate Well Clear Recovery guidance in the presence of realistic sensor, tracking and navigational errors, and (4) validate DAA alerting and guidance requirements in the presence of realistic sensor, tracking and navigational errors. The results will be presented at RTCA Special Committee 228 in support of final verification and validation of the DAA MOPS.

Detect-And-Avoid (DAA)↗

Similarity Metrics for Closed Loop Dynamic Systems

To what extent and in what ways can two closed-loop dynamic systems be said to be "similar?" This question arises in a wide range of dynamic systems modeling and control system design applications. For example, bounds on error models are fundamental to the controller optimization with modern control design methods. Metrics such as the structured singular value are direct measures of the degree to which properties such as stability or performance are maintained in the presence of specified uncertainties or variations in the plant model. Similarly, controls-related areas such as system identification, model reduction, and experimental model validation employ measures of similarity between multiple realizations of a dynamic system. Each area has its tools and approaches, with each tool more or less suited for one application or the other. Similarity in the context of closed-loop model validation via flight test is subtly different from error measures in the typical controls oriented application. Whereas similarity in a robust control context relates to plant variation and the attendant affect on stability and performance, in this context similarity metrics are sought that assess the relevance of a dynamic system test for the purpose of validating the stability and performance of a "similar" dynamic system. Similarity in the context of system identification is much more relevant than are robust control analogies in that errors between one dynamic system (the test article) and another (the nominal "design" model) are sought for the purpose of bounding the validity of a model for control design and analysis. Yet system identification typically involves open-loop plant models which are independent of the control system (with the exception of limited developments in closed-loop system identification which is nonetheless focused on obtaining open-loop plant models from closed-loop data). Moreover the objectives of system identification are not the same as a flight test and hence system identification error metrics are not directly relevant. In applications such as launch vehicles where the open loop plant is unstable it is similarity of the closed-loop system dynamics of a flight test that are relevant.

Whorton, Mark S.↗

Results from NASA's Near Real Time Ozone Data Assimilation Systems

Organizations in Europe, Australia, and the United States have recently broadened constituent assimilation activities beyond water vapor, which has been assimilated for years in the numerical weather prediction applications. Many of these activities have focused on ozone, with some efforts focused on the entire suite of reactive constituents that control the ozone distribution. This talk will draw from results from the near real-time ozone data assimilation system being run by NASA's Data Assimilation Office. This system utilizes ozone observations from both the TOMS and the SBUV instrument to generate global synoptic maps of ozone. The initial application of this product is to provide ozone fields to assist in the atmospheric corrections' that are necessary for the retrieval of information from other NASA instruments. The validation of the ozone assimilation system shows that the assimilated product agrees well with independent HALOE and ozonesonde observations. Aside from providing a global synoptic map, there is verifiable geophysical information at higher vertical resolution than either of the date types input into the system. This talk will establish the validation results and enumerate applications of the ozone data assimilation system. Results from exploratory research will be presented. The applications being considered include estimates of tropospheric ozone, provision of ozone fields for interactive retrievals, use of analysis increments from the assimilation to evaluate model performance, and development of long-term consistent three-dimensional global ozone fields. The results from the exploratory studies are promising, and help demonstrate how assumptions made in the development of the ozone assimilation impact the other applications. For instance, RMS errors in the current product are large near the tropopause, which is sensitive to the specification of vertical correlation functions, which in turns impacts the amount of ozone analyzed to be in the troposphere. How these sensitivities impact the different applications will also be discussed.

Rood, Richard B.↗

EGS Collab Experiment 2: Microseismic Monitoring

This dataset contains continuous seismic waveform data recorded during stimulation and thermal circulation tests for the Enhanced Geothermal Systems (EGS) Collab Experiment #2, conducted from February to September 2022 at the Sanford Underground Research Facility in Lead, South Dakota. This experiment aimed to study and validate models of geothermal systems by injecting high-pressure fluids into rock formations 1200-1500 meters below the surface, inducing microseismic events. The seismic monitoring system included 16 three-component accelerometers and a 24-channel hydrophone array, installed in boreholes surrounding the test area. Data were recorded at high sampling rates using a continuous waveform recording system to monitor seismic activity in real time. The dataset contains the raw data stored in binary format, with files named based on timestamps, and includes calibration certificates for some sensors to facilitate corrections to real units. Users are strongly advised to consult the accompanying detailed report, which outlines the experimental setup, sensor specifications, installation procedures, and data processing methods. The report also describes important nuances, such as the hardware filters on hydrophones, sensor calibration details, and the naming conventions for the recorded data. Proper use of this dataset may require familiarity with seismic data analysis tools, such as the Obspy Python package, and an understanding of the SEED naming conventions used for channel identification.

15 GEOTHERMAL ENERGY↗

Drive System Research

An overview of the NASA Glenn Research Center Drive Systems Research will be presented. The primary purpose of this research is to improve performance, reliability, and integrity of aerospace drive systems and space mechanisms. The research is conducted through a combination of in-house, academia, and through contractors. Research is conducted through computer code development and validated through component and system testing. The drive system activity currently has four major thrust areas including: thermal behavior of high speed gearing, health and usage monitoring, advanced components, and space mechanisms.

Handschuh, Robert F.↗