Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

Integrated Thermal Energy Storage and Brayton Cycle Equipment Demonstration (Integrated TESTBED) Project Design Basis

The Integrated Thermal Energy Storage and Brayton cycle Equipment Demonstration (Integrated TESTBED) project seeks to retire commercial-scale risks associated with the design, integration,and operation of a supercritical carbon dioxide (sCO2) power cycle and concentrating solar power (CSP) thermal energy storage (TES) system. This requires an understanding of commercial-scale collector system transient impacts on the TES system, the dynamics of heat exchange from theTES to the power cycle, and the control and operation of the power cycle to accommodate various dispatch strategies. In order to retire these risks, Heliogen has proposed to construct a 5 MWe CSP demonstration facility based on directly heated particle and sCO2 technology. The receivers, primary heat exchanger, and power cycle will be deployed at a full commercial scale based on Heliogen’s modular plant architecture to ensure actual system integration risks are validated during design, construction, and operation. This work summarizes the design basis for the Integrated TESTBED project demonstration facility including a design target for capacity factor to support test operations, hours of storage, particle silo arrangement, centrifugal article receivers, a diffusion bonded particle-sCO2 heat exchanger, and a 5 MWe (net) integrally geared sCO2 recompression Brayton cycle.

14 SOLAR ENERGY↗

Machine Learning for Fairness-Aware Load Shedding: A Real-Time Solution via Identifying Binding Constraints: Preprint

Timely and effective load shedding in power systems is critical for maintaining supply-demand balance and preventing cascading blackouts. To eliminate load shedding bias against specific regions in the system, optimization-based methods are uniquely positioned to help balance between economic and fairness considerations. However, the resulting optimization problem involves complex constraints, which can be time-consuming to solve and thus cannot meet the real-time requirements of load shedding. To tackle this challenge, in this paper we present an efficient machine learning algorithm to enable millisecond-level computation for the optimization-based load shedding problem. Numerical studies on both a 3-bus toy example and a realistic RTS-GMLC system have demonstrated the validity and efficiency of the proposed algorithm for delivering fairness-aware and real-time load shedding decisions.

97 MATHEMATICS AND COMPUTING↗

Design for validation, based on formal methods

Validation of ultra-reliable systems decomposes into two subproblems: (1) quantification of probability of system failure due to physical failure; (2) establishing that Design Errors are not present. Methods of design, testing, and analysis of ultra-reliable software are discussed. It is concluded that a design-for-validation based on formal methods is needed for the digital flight control systems problem, and also that formal methods will play a major role in the development of future high reliability digital systems.

Butler, Ricky W.↗

Techno-Economic Analysis and Market Potential of Geological Thermal Energy Storage (GeoTES) Charged With Solar Thermal and Heat Pumps

In this project, we developed a techno-economic analysis (TEA) model that can be used to evaluate the viability of a proposed Geological Thermal Energy Storage (GeoTES) design. This MATLAB-based model integrates distinct subsystem models for the reservoir, wells, power cycle, and solar field to capture their distinct characteristics. It applies this approach in simulating GeoTES storage and dispatch operations for durations ranging from hourly to seasonal. Using cases studies based on GeoTES designs provided by industry partners - Premier Resource Management (PRM) and EarthBridge Energy - we validated the TEA model estimations of system performance and costs (such as thermal and electrical power/energy inflow and outflow, capital costs, and levelized costs of energy and storage) for both concentrating solar thermal (CST) and Carnot Battery (CB) pairings with GeoTES (CST-GeoTES and CB-GeoTES). For the CST-GeoTES case, the model was validated against the proposed system designed by PRM. It showed good agreement with PRM's estimations when well and pump costs derived from PRM's estimations were used. When GETEM-based costs were used, there was a slight overprediction due to GETEM's project/site agnostic assumption of these costs. From a sensitivity analysis perspective, the levelized cost of electricity (LCOE) of the CST-GeoTES case was most sensitive to well flow rate and the charging temperature. An optimal design scenario resulted in an LCOE of 0.11 $\$$/kWhe. CST-GeoTES can also provide a source of heat to meet seasonal demands. With 12-hour and 24-hour levelized cost of heat (LCOH) of 0.018 $\$$/kWhth and 0.022 $\$$/kWhth, respectively, CST-GeoTES could be competitive in the California market with an average industrial price of natural gas in California between 0.041-0.047 $\$$/kWhth. The levelized cost of storage (LCOS) for CST-GeoTES depends on the energy storage duration. Although the LCOS is relatively higher for shorter durations (e.g., ~0.50 $\$$/kWhe for 1 hour of storage), it is an order of magnitude lower (0.06 $\$$/kWhe) for longer storage durations and competitive with lithium-ion batteries (beyond 12 hours of storage) and molten-salt thermal energy storage (beyond 32 hours). Energy. Three options were explored and applied to the EarthBridge case study: (1) A Carnot Battery design using R125 working fluid with both hot and cold storage; (2) A Carnot Battery design using R125 working fluid with only hot storage; (3) A Carnot Battery using a commercially available heat pump with carbon dioxide (CO2) working fluid and hot storage only. The CB-GeoTES with cold storage only had a slight (round-trip) efficiency advantage over the system without (43.4% vs. 42.8%). This is because the cold storage is limited by the freezing point of water, so the cold storage is not much colder than the environment. The system using commercially available technologies was the least efficient - partly because different cycles were used in the heat pump (CO2) and heat engine (binary cycle) which leads to some inefficiencies. Using the commercially available design, the levelized cost of energy (LCOS) from the model (0.10 $\$$/kWhe) was higher than that estimated by EarthBridge (0.068 $\$$/kWhe). This is because of the low round-trip (38.7%) efficiency of the commercially available design. Sensitivity analysis reveals that the model is most sensitive to electricity price. Including electricity price in the TEA for CB-GeoTES leads to an increase in LCOS from the base value to 0.25 $\$$/kWhe. To determine storage sites suitable for GeoTES, we gathered and analyzed geological, petrophysical, and geophysical data of oil and gas reservoir and aquifers in California and Texas. We down-selected possible sites based on cut-off values for site characteristics (e.g., reservoir temperature, formation thickness, permeability, porosity, depth, and brine salinity) and preliminary costs. Using this approach, the Carrizo-Wilcox, Yegua-Jackson, and Dockum brackish aquifers in Texas were identified as having the highest suitability. Similarly, in the central California region, the White Wolf, Belridge South Tulare, and Belridge South Reef Ridge were the most suitable. Going further, we assessed the storage potential in the selected sites. To do this we developed distributions of reservoir characteristic data and applied a Monte Carlo-based analysis to account for intrinsic uncertainty in the acquired data. The analysis revealed that the Carrizo-Wilcox aquifer had the highest storage potential with a mean capacity of 554 TWhth (i.e., 63 TWhe). The estimated capacity serves as an upper limit of storage potential given that not all fields in the basin will be developed. We participated in multiple outreach activities including conference presentations, panel session discussions, and the facilitation of a GeoTES workshop at the NREL Golden campus.

15 GEOTHERMAL ENERGY↗

Automated space vehicle control for rendezvous proximity operations

Rendezvous during the unmanned space exploration missions, such as a Mars Rover/Sample Return will require a completely automatic system from liftoff to docking. A conceptual design of an automated rendezvous, proximity operations, and docking system is being implemented and validated at the Johnson Space Center (JSC). The emphasis is on the progress of the development and testing of a prototype system for control of the rendezvous vehicle during proximity operations that is currently being developed at JSC. Fuzzy sets are used to model the human capability of common sense reasoning in decision making tasks and such models are integrated with the expert systems and engineering control system technology to create a system that performs comparably to a manned system.

Lea, Robert N.↗

Automated space vehicle control for rendezvous proximity operations

Rendezvous during the unmanned space exploration missions, such as a Mars Rover/Sample Return will require a completely automatic system from liftoff to docking. A conceptual design of an automated rendezvous, proximity operations, and docking system is being implemented and validated at the Johnson Space Center (JSC). The emphasis is on the progress of the development and testing of a prototype system for control of the rendezvous vehicle during proximity operations that is currently being developed at JSC. Fuzzy sets are used to model the human capability of common sense reasoning in decision-making tasks and such models are integrated with the expert systems and engineering control system technology to create a system that performs comparably to a manned system.

Lea, Robert N.↗

IV and V Issues in Achieving High Reliability and Safety in Critical Control System Software

Risk analysis and integrated verification and validation are two important elements in a plan for ensuring the safety of critical software systems. We describe an approach we are currently developing for integrating risk analysis, and metrics analysis, and propose a fault predictor that would integrate the results of these activities. Practical difficulties associated with our approach are also discussed, as are limitations of the proposed predictor. We conclude with a discussion of what as been learned to date, and with suggestions for future work.

validation software reliability software risk asse↗

CFD Validation and Scaling of a Condenser Used in an ISRU Propellant Production System

This work develops a Computational Fluid Dynamics (CFD) model of a Commercial-Off-The-Shelf (COTS) condenser used for ground-based testing of an In-Situ Resource Utilization (ISRU) propellant production system. STAR-CCM+ was used to simulate water condensing through the condenser downstream of a methanation reactor. The computational data of the digital model is validated with test cases using nitrogen and water in ambient conditions. After validation with the test data, the digital model can be used to predict scale at higher production targets. The StarCCM+ simulation of the digital model shows good agreement with the test data provided. From the simulation, the condensation rate calculated was 18.3 g/hr and the process gas mass flow rate was 709.2 g/hr. The test data measured an average 16.9 g/hr condensation rate and 693.6 g/hr process gas mass flow rate. The simulation shows a 7.3% error in the water condensation and 2.2% error in the process gas at the outlet.

Condenser↗

Validation of Minimum Display Requirements for a UAS Detect and Avoid System

The full integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS), a prerequisite for enabling a broad range of public and commercial UAS operations, presents several technical challenges to UAS developers, operators and regulators. A primary barrier is the inability for UAS pilots (situated at a ground control station, or GCS) to comply with Title 14 Code of Federal Regulations sections 91.111 and 91.113, which require pilots to “see and avoid” other aircraft in order to maintain well clear. UAS pilots’ removal from the flight deck of the aircraft necessitates the development of a UAS-specific system for detecting nearby traffic and displaying traffic information to the pilot to support their ability to maintain an objectively defined “DAA well clear” threshold from other aircraft. This new UAS-specific function of remaining DAA well clear is called traffic avoidance. The resulting Detect and Avoid (DAA) system, however, will be subject to a collection of requirements that manufacturers will be obligated to meet in order to certify their equipment. RTCA Special Committee 228 (SC-228), a consortium of representatives from government, industry and academia, is responsible for developing and documenting the Minimum Operational Performance Standards (MOPS) for UAS DAA systems. The present study is the final in a series of human-in-the-loop (HITL) experiments designed to explore and test the various display and alerting requirements being incorporated into the DAA MOPS. Whereas the prior DAA HITLs examined a wide variety of DAA display features and concepts, the current experiment aims to validate the latest minimum display requirements for Phase 1 of the DAA MOPS. Rather than test different display concepts, this study tests two configurations of a MOPS-compatible DAA display: a version that is integrated into the primary navigation and control display of the GCS and a version that is physically separated from the primary display. This manipulation tests the draft minimum requirement that allows the DAA traffic display to be a separate, or standalone, configuration. This type of configuration is a more achievable near-term technology solution since it does not stipulate additional certification or integration requirements on UAS manufacturers. However, a standalone display configuration has the potential to result in pilot performance issues resulting from the cognitive costs of switching between the primary DAA display and the primary navigation and control display. This configuration is also particularly susceptible to errors if the displays are in different orientations (e.g., north-up versus track-up). Both the integrated and standalone display configurations were presented to 16 active UAS pilots in a medium-fidelity simulation, which included confederate air traffic controllers and pseudo pilots operating simulated manned traffic. Pilots were tasked with navigating two different mission routes while maintaining DAA well clear with scripted conflicts. Pilot response times (i.e., measured response) and ability to remain DAA well clear are reported. Primary results indicate that both display configurations resulted in favorable response times and well clear rates. While there were clear trends of pilots objectively performing better in the integrated display condition, with several measured response metrics reaching statistical significance, the differences between the two displays were typically moderate. While the primary variable of DAA display location did not have an especially large impact on pilot performance on its own, when examined alongside the type of DAA threat the pilot was facing (a caution-level versus a warning-level alert), the response time benefits associated with the integrated display were amplified. The implications of these American Institute of Aeronautics and Astronautics 2 results on the Phase 1 DAA MOPS and the connection of this data to previous studies is also discussed.

detect and avoid↗

Integrating Bioregenerative Foods into the Exploration Spaceflight Food System

Food, the nutrition it provides, and the eating experiences surrounding it, are central to performance, health, and psychosocial wellbeing on long duration spaceflight missions. Exploration missions will require a spaceflight food system that is safe, nutritious, and acceptable for up to five years, possibly without cold storage. Many of the processed and packaged spaceflight foods currently used on the International Space Station will not retain acceptable quality or required levels of key nutrients under these conditions. The addition of bioregenerative produce to exploration missions may become an important countermeasure to the nutritional gaps and a resource to support psychosocial health. Bioregenerative produce will be central to establishment of Earth-independence as exploration extends deeper into space. However, bioregenerative foods introduce food safety and scarcity risks that must be eliminated prior to crew reliance on these systems. The pathway to Earth independence will require small-scale integration and validation prior to large scale bioregenerative dependence. Near term exploration missions offer the opportunity to establish small scale supplemental salad crop and fruit systems and validate infrastructure reliability, nutritional potential, and the psychosocial benefits necessary to promote further bioregenerative integration.

Douglas, Grace L.↗

Computational Experiment Design for Operations Model Simulation

Computer simulations that demonstrate the value of novel approaches are crucial to developing more flexible and robust power systems operations with high penetrations of renewable energy at multiple geographic and temporal scales. However, optimization-based simulations that depend on forecast data often face challenges in evaluating performance, reproducing results, and testing under realistic simulation scenarios. In this paper, we develop scientific computing best-practices for the validation and reproduction of power systems operational models. We then employ two case studies to demonstrate the proposed validation and reproduction framework.

MATHEMATICS AND COMPUTING,POWER TRANSMISSION AND D↗

Versatile allelic replacement and self-excising integrative vectors for plasmid genome mutation and complementation

ABSTRACT The ability to better understand the function of proteins expressed by bacteria has typically relied upon the development of genetic mutant strains. This approach has been especially challenging for plasmid-encoded genes, as most of the previously described allelic replacement vectors are inefficient for plasmid genome mutation as they either rely on plasmid-derived counterselection toxins or depend on other strategies suchsacB,tetA, andrpsLwhich have been proven to be less efficient for mutant selection. Integrative vectors lack chromophore indicators, thus requiring laborious screening or excision of the vector’s backbone relies on the introduction of a flippase (FLP)-expressing plasmid. The allelic replacement vector, designated here as pDG1, expresses an X-Gal hydrolyzing enzyme (BgaB) that can be used for blue/white screening allowing identification of colonies that integrated and successfully removed the mutagenesis plasmid without a bias for those still carrying it. pDG1 was further improved by including the rhamnose-inducible Tse2 toxin as a potent counterselection system. The efficacy of pDG1 was validated by deleting portions of the plasmid-encoded VirB4/D4 type IV secretion system and aerobactin-synthesizing operons inSalmonella enterica. The integrative vectors, which contain an ΦC31attPsite and genes encoding ΦC31 integrase (int), can seamlessly integrate to target ΦC31attBonSalmonellaplasmids or chromosome. These vectors were improved by insertingbgaBand FLP-encoding genes so that, following integration, most of the vector’s backbone encompassingint,bgaB, and FLP genes can be excised by FLP, without the need for another FLP-expressing vector, creating white colonies carrying a stably integrated target gene. As such, we were able to integrate a 9.3-kb DNA fragment toSalmonellachromosome and flipped out most of the integrated vector in one step, leaving the target fragment in the chromosome. IMPORTANCE In spite of the dissemination of multidrug-resistant plasmids among Gram-negative pathogens, including those carrying virulence genes, vector tools for studying plasmid-born genes are lacking. The allelic replacement vectors can be used to generate plasmid or chromosomal mutations including markless point mutations. This is the first report describing a self-excising integrative vector that can be used as a stable single-copy complementing tool to study medically important pathogens includingin vivostudies without the need for antibiotic selection. Overall, our newly developed vectors can be applied for the assessment of the function of plasmid-encoded genes by specifically creating mutations, moving large operons between plasmids and to/from the chromosome, and complementing phenotypes associated with gene mutation. Furthermore, the vectors express chromophores for the detection of target gene modification or colony isolation, avoiding time-consuming screening procedures.

Microbiology↗

Small-Signal Stability Support from Dynamically Configurable Grid-Forming/Following Inverters for Distribution Systems: Preprint

As the penetration of inverter-based resources (IBRs) continues to increase in modern power systems, system stability is challenged by the insufficient inertia induced by IBRs; hence, there is a need to develop various methods to address the potential instabilities. In this paper, grid-forming (GFM) and grid-following (GFL) controls are implemented for inverters with flexible-mode transitions between them. The operation mode transition between GFM and GFL controls is adopted as an additional degree of control flexibility to adjust the small signal stability margin. Further, a holistic and detailed small signal model of the entire system with the dynamics from both synchronous generators (SGs) and IBRs is derived. The effectiveness of the proposed work in adjusting the system small signal stability margin is validated by conducting case studies with varying penetration levels of IBRs. A test system with one SG and five inverters was implemented in MATLAB/Simulink to demonstrate the effectiveness of the proposed approach. Index Terms - grid-following control, grid-forming control, operation mode transition, small-signal stability analysis

grid-following control↗

Tank Pressure Control Experiment - A low-g mixing investigation

The Tank Pressure Control Experiment (TPCE) was conceived to meet the need for an aspect of cryogenic fluid management technology that is critical to several future national space missions: control of cryogenic storage tank pressures by active mixing. In-space testing is the only means of obtaining the fluid dynamic data necessary to develop and test predictive models of mixing. These models, when validated, will allow future cryogenic systems to be designed with more efficient and reliable pressure control systems. The objectives of the TPCE project are to characterize the fluid dynamics of jet-induced mixing in low gravity, evaluate the validity of empirical models and correlations, and provide data for use in developing and validating computational fluid dynamic models. This paper discusses prior studies of low-g mixing, the objectives and benefits of TPCE, the design and status of the payload, and preliminary results obtained from low-g aircraft testing.

Bentz, M. D.↗

A Comprehension Based Analysis of Autoflight System Interfaces

This cooperative agreement supported Dr. Peter Polson's participation in two interrelated research programs. The first was the development of the Situation-Goal-Behavior (SGB) Model that is both a formal description of an avionics system's logic and behavior and a representation of a system that can be understood by avionics designers, pilots, and training developers. The second was the development of a usability inspection method based on an approximate model, RAFIV, of pilot interactions with the Flight Management System (FMS). The main purpose of this report is to integrate the two models and provide a context in order to better characterize the accomplishments of this research program. A major focus of both the previous and this Cooperative Agreement was the development of usability evaluation methods that can be effectively utilized during all phases of the design, development, and certification process of modern avionics systems. The current efforts to validate these methods have involved showing that they generate useful analyses of known operational and training problems with the current generation of avionics systems in modern commercial airliners. This report is organized into seven sections. Following the overview, the second section describes the Goal-Situation-Behavior model and its applications. The next section summarizes the foundations of the RAFIV model and describes the model in some detail. The contents of both these sections are derived from previous reports referenced in footnotes. The fourth section integrates these two models into a complete design evaluation and training development framework. The fifth section contains conclusions and possible future directions for research. References are in Section 6. Section 7 contains the titles and abstracts of the papers paper describing in more detail the results of this research program.

Palmer, Everett↗

Lunar Proving Grounds Definition

The Lunar Surface Innovation Consortium (LSIC) is hosting a hybrid Lunar Proving Grounds Definition Workshop, July 12-13,2023, at the Johns Hopkins University Applied Physics Laboratory in Laurel, Maryland, and on Zoom. The topic of facilities needed for testing hardware destined for the Moon and the need for Earth-based ‘Lunar Proving Grounds’ for testing systems has come up across all six Focus Areas of LSIC. While facilities exist for component- and instrument- level technology maturation (e.g., up to system/subsystem demo in relevant environments), and there are potential flight opportunities for component maturation to flight-qualified and even flight-proved systems, the Artemis Program vision for a sustained presence and transition to industry (e.g., the Moon to Mars Objectives and the LSIC “Path to an Enduring Lunar Presence” white paper) suggests an architecture of integrated systems and systems of systems more complex than Apollo or the International Space Station. Some questions we aim to address through this workshop include: (1) How will validation and verification of these systems and interactions, including human-robotic operations, be accomplished? (2) What metrics need to be tested, and thus what capabilities will such a facility or facilities need? (3) Which functionalities can be tested separately and which need to synergize? What can be the role of digital engineering?

Proving Grounds↗

Adaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to the analysis of safety-critical systems that operate over a sequence of time steps, such as aircraft collision avoidance systems and autonomous cars. In many applications such as autonomous driving, failures cannot be completely eliminated due to the complex stochastic environment in which the system operates.As a result, safety validation is not only concerned about whether a failure can occur, but also discovering which failures are most likely to occur. This article presents adaptive stress testing (AST), a framework for finding the most likely path to a failure event in simulation. We consider a general black box setting for partially observable and continuous-valued systems operating in an environment with stochastic disturbances. We formulate the problem as a Markov decision process and use reinforcement learning to optimize it. The approach is simulation-based and does not require internal knowledge of the system, making it suitable for black-box testing of large systems. We present different formulations depending on whether the state is fully observable or partially observable. In the latter case, we present a modified Monte Carlo tree search algorithm that only requires access to the pseudorandom number generator of the simulator to overcome partial observability. We also present an extension of the framework, called differential adaptive stress testing (DAST), that can find failures that occur in one system but not in another. This type of differential analysis is useful in applications such as regression testing, where we are concerned with finding areas of relative weakness compared to a baseline. We demonstrate the effectiveness of the approach on an aircraft collision avoidance application, where a prototype aircraft collision avoidance system is stress tested to find the most likely scenarios of near mid-air collision.

Verification and Validation↗