Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Dynamic analysis of free-piston Stirling engine/linear alternator-load system - Experimentally validated

This paper discusses the effects of a variations in system parameters on the dynamic behavior of a Free-Piston Stirling Engine/Linear Alternator (FPSE/LA)-load system. The mathematical formulations incorporates both the mechanical and thermodynamic properties of the FPSE, as well as the electrical equations of the connected load. State-space technique in the frequency domain is applied to the resulting system of equations to facilitate the evaluation of parametric impacts on the system dynamic stability. Also included is a discussion on the system transient stability as affected by sudden changes in some key operating conditions. Some representative results are correlated with experimental data to verify the model and analytic formulation accuracies. Guidelines are given for ranges of the system parameters which will ensure an overall stable operation.

Kankam, M. D.↗

Foundational Open Source Solar System Modeling Through Improvement and Validation of the System Advisor Model and PVWatts (FY19-FY21 Final Technical Report)

Accelerating intelligent deployment of solar energy technologies demands accurate system modeling every step of the way. From project development to policy research, grid integration studies to development of novel technologies, industry and researchers alike need validated, transparent, easy-to-use, extensible, cutting-edge, and accurate models of both the performance and financing of solar systems. The System Advisor Model (SAM) and PVWatts tools provide a platform to fill that need. The overarching goal of this set of software tools is to enable accurate PV system modeling across the industry, and our usage metrics indicate that we continue to succeed in that endeavor, with a user starting SAM every 2 minutes globally, and over 17 million PVWatts hits per month. This project leveraged DOEs past investment in the SAM and PVWatts platforms to continue to provide valuable and extensible PV, battery, and financial modeling resources to the larger solar community. We pursued multiple avenues in parallel: software maintenance and technical support that are foundational to the continued usability of the SAM and PVWatts platforms; platform and PV model improvements and stakeholder engagement activities that are core to the continued relevance of the platforms; and open source activities to foster the continued creation of a vibrant open-source community around the SAM and PVWatts tools, which opens up exciting new opportunities for industry interaction.

14 SOLAR ENERGY↗

Development of the INL Thermal Energy Distribution System (TEDS) in the Modelica Eco-System for Validation and Verification

This report provides an overview on the development of the Thermal Energy Distribution System (TEDS) in the Modelica process model eco-system at Idaho National Laboratory as part of the integrated energy system initiative. Model development has led to the creation of a dynamic process model of the experimental TEDS facility housed within the Engineering Science Laboratory (ESL) at INL. The model was then used during the pre-construction phase of the experimental effort to inform experimental design (insulation requirements, bypass line placement, expected performance of components) and to test innovative control schemes prior to the initial operation. The TEDS model developed in Modelica includes the primary components of the TEDS experimental unit including: a 200kW Chromalox heater, a single-tank packed bed thermal energy storage system filled with 0.125 inch Alumina (Al 2 O 3 ), an ethylene-glycol to Therminol-66 heat exchanger, system piping, six control valves, and all associated temperature, pressure, and mass flow sensors. The model does not include nitrogen fill gas tanks, or associated overfill tanks, as these are not part of standard system control. Two simulation sets were run. The first is a five-hour test that operates as a shakedown test for the facility. This simulation puts the facility through all five potential operating modes and showcases the ability of valving, control sensors, and component controllers to meet the system demands. The second case imposes a typical summer day demand on the system from a region with mixed commercial and residential electrical needs where the generator alone cannot meet peak demand but instead requires the thermal storage unit to act as a peaking unit. Over the course of the fifteen-hour discharge cycle heat losses account for a heat loss of approximately 15°C in outlet temperature. Such heat losses would lead to a decrease in overall system efficiency and may lead to additional design changes for such designs in the future that may include a topping heater. Through commencement of this work, a systems level model of TEDS with associated control systems, sensors, piping diameters, and component capabilities has been created. This model has been utilized in the pre-experimental phase to inform system design, insulation thicknesses, and potential control schemes to operate the system effectively and safely. Once TEDS begins operation, this model will be refined, tuned, and used for validation and verification purposes.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A methodology to develop multi-physics dynamic fuel cell system models validated with vehicle realistic drive cycle data

Fuel cell (FC) technology has been identified as a technically attractive solution to decarbonize the transportation sector, especially for heavy-duty vehicles. In this context, the industry and the scientific community are in need of advanced fuel cell systems (FCS) models that are able to replicate real -world operating conditions. Due to the scarcity of said models in the open literature, this study aimed to develop a comprehensive methodology to calibrate and validate multi -physics dynamic FCS models. Therefore, the key contribution of this paper is the detailed description of the calibration process for each component and the calibration order. The specific focus here was to accurately describe the behavior of the FC stack as well as the cathode, anode, and cooling circuits of the balance of plant. The model was calibrated with the aid of experimental data from a Toyota Mirai FC electric vehicle, which was predominantly retrieved from the vehicle's Controller Area Network (CAN) bus system thereby negating the need for major intrusion into the powertrain system. The validation process was deemed successful with the model being able to truthfully replicate the characteristics of the FC vehicle operated on the World-wide harmonized Light duty Test Cycle (WLTC) 3b and US06 driving cycle. The time -resolved physical parameters such as the cathode pressure, mass flow, or the FC stack temperature were captured with high fidelity, while the overall performance parameters such as the H2 consumption in the stack and the system, and the compressor energy consumption were predicted accurately with a deviation lower than 0.47%, 1.75% and 1.89% with respect to the experimental data, respectively.

Lopez-Juarez, Marcos↗

Development of a knoweledge-based system for validating finite element models

The finite element modeling of an airframe structure requires knowledge of general purpose programs such as NASTRAN as well as a detailed understanding of the airframe structure. Due to the sophistication of general purpose programs such as NASTRAN, a substantial investment in time and effort is required to gain expertise in using them effectively. This paper describes the development of an expert system used in the validation of NASTRAN based finite element models. Experts in the NASTRAN based finite element modeling of airframe structures were interviewed to document, understand, and represent their knowledge and reasoning in the expert system. Finite element stress analysis and internal loads reports generated by the experts were reviewed to determine expert resolution of problem areas. As a result, areas requiring expert assistance in the modeling of the airframe structures were identified. The finite element input data is represented as a set of 'facts'. A rule based representation is used to code the expert knowledge. A hierarchical set of rules are applied. The expert system first acts as an intelligent front end to insure that all the prerequisites needed to perform the analysis are present. This includes material properties, boundary conditions, and connectivity information. The next step examines if incompatible sets of elements are connected. The succeeding step examines if the specific airframe component is modeled by the appropriate set of elements. The next and final step examines if the airframe members used are adequate to represent the anticipated state of stress. The expert system is designed to inform the user the severity of the error, the likely consequence and possible remedial action. The shell used in the development of the expert system is CLIPS. CLIPS contains a forward chaining inference engine based on the Rete algorithm. CLIPS may be implemented on most personal computers as well as mini computers and mainframes. The approach taken is general and can be implemented using commercially available expert system shells.

Munir, N. I.↗

Application of Artificial Intelligence in Detection and Mitigation of Human Factor Errors in Nuclear Power Plants: A Review

Human factors and ergonomics have played an essential role in increasing the safety and performance of operators in the nuclear energy industry. In this critical review, we examine how artificial intelligence (AI) technologies can be leveraged to mitigate human errors, thereby improving the safety and performance of operators in nuclear power plants (NPPs). First, we discuss the various causes of human errors in NPPs. Next, we examine the ways in which AI has been introduced to and incorporated into different types of operator support systems to mitigate these human errors. We specifically examine (1) operator support systems, including decision support systems, (2) sensor fault detection systems, (3) operation validation systems, (4) operator monitoring systems, (5) autonomous control systems, (6) predictive maintenance systems, (7) automated text analysis systems, and (8) safety assessment systems. Finally, we provide some of the shortcomings of the existing AI technologies and discuss the challenges still ahead for their further adoption and implementation to provide future research directions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Interactive Power to Frequency Dynamics Between Grid-Forming Inverters and Synchronous Generators in Power Electronics-Dominated Power Systems

With increased attention on grid-forming inverters as a power system stabilizing device during high shares of inverter-based resource operations, there is a present need for a transparent and methodical investigation of the inverted and direct power to frequency control capabilities and impacts of these devices on emerging power systems. Here, analysis of the frequency dynamics of the droop-controlled grid-forming inverter and the synchronous generator illuminates the inverted active power-frequency relationship and the frequency response order reduction, forming the basis for novel, nonlinear frequency control approaches. Device-level electromagnetic transient domain simulations corroborate the order-reduction findings, establish that a properly designed dc-side system has a negligible impact on power transfer and will not impede frequency regulation, and confirm the primary frequency response improvement with nonlinear control. Simulations of the 9- and 39-bus test systems validate the order reduction and associated decoupling of the nadir and rate of change of frequency in larger networks. Oscillatory mode analysis confirms the grid-forming benefit of increased damping; decreased damping is observed at shares above 80%, but not at 100%. Finally, simulations on a validated Maui power system model with a 96% of inverter-based resources model yield a trend toward a first-order response.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Propulsion Powertrain Real-Time Simulation Using Hardware-in-the-Loop (HIL) for Aircraft Electric Propulsion System

It is essential to design a propulsion powertrain real-time simulator using the hardware-in-the-loop (HIL) system that emulates an electrified aircraft propulsion (EAP) systems power grid. This simulator would enable us to facilitate in-depth understanding of the system principles, to validate system model analysis and performance prediction, and to demonstrate the proof-of-concept of the EAP electrical system. This paper describes how subscale electrical machines with their controllers can mimic the power components in an EAP powertrain. In particular, three powertrain emulations are presented to mimic 1) a gas turbo-=shaft engine driving a generator, consisting of two permanent magnet (PM) motors with brushless motor drives, coupled by a shaft, 2) a motor driving a propulsive fan, and 3) a turbo-shaft engine driven fan (turbofan engine) operation. As a first step towards the demonstration, experimental dynamic characterization of the two motor drive systems, coupled by a mechanical shaft, were performed. The previously developed analytical motor models1 were then replaced with the experimental motor models to perform the real-time demonstration in the predefined flight path profiles. This technique can convert the plain motor system into a unique EAP power grid emulator that enables rapid analysis and real-time simulation performance using hardware-in-the-loop (HIL).

turbo-electric propulsion↗

System performance testing of the DSN radio science system, Mark 3-78

System performance tests are required to evaluate system performance following initial system implementation and subsequent modification, and to validate system performance prior to actual operational usage. Non-real-time end-to-end Radio Science system performance tests are described that are based on the comparison of open-loop radio science data to equivalent closed-loop radio metric data, as well as an abbreviated Radio Science real-time system performance test that validates critical Radio Science System elements at the Deep Space Station prior to actual operational usage.

Berman, A. L.↗

Validating system-level error recovery for spacecraft

The system-level software onboard a spacecraft is responsible for recovery from communication, thermal, power, and computer-health anomalies that may occur. The recovery must occur without disrupting any critical scientific or engineering activity that is executing at the time of the error. Thus, the error-recovery software may have to execute concurrently with the ongoing acquisition of scientific data or with spacecraft maneuvers. This paper provides a technique by which the rules that constrain the concurrent execution of these processes can be modeled in a graph. An algorithm is described that uses this model to validate that the constraints hold for all concurrent executions of the error-recovery softwave with the softwave that controls the science and engineering events on the spacecraft.

Lutz, Robyn R.↗

Introduction to the JPSS-2 Advanced Technology Microwave Sounder (ATMS) Government Calibration Data Book (GCDB)

The third Advanced Technology Microwave Sounder (ATMS) is an instrument onboard the Joint Polar Satellite System (JPSS), JPSS-2 (renamed NOAA-21 in orbit) mission. This report is to introduce the JPSS-2 Government Calibration Data Book (J2 GCDB) for ATMS, SN 304. This J2 GCDB document contains key information generated during the calibration testing campaign that is driving parameters for radiometric performance. This document also contains supporting data that augments the calibration results. The values in this document are utilized by ATMS’s calibration packet which is, in turn, an integral component in the interpretation of science data. The calibration data in this report was collected from tests such as shelf-level testing, antenna testing, instrument thermal vacuum (TVAC) testing; satellite TVAC testing; and JPSS-2 post-launch tests. JPSS-2 was launched on November 10, 2022. In the subsequent years, the Government will release an ATMS GCDB for each JPSS mission. We expect that all public users can download these ATMS GCDBs from the NOAA operational Integrated Calibration and Validation System (ICVS) website, see more discussions below. The goal of this GCDB is to demonstrate how to characterize ATMS measurements using JPSS-2 ATMS on-orbit operational data and to provide relevant explanations. This document serves as a primary public domain reference for calibrating operational ATMS Raw Data Records (RDR) science data, as used in the current operational Interface Data Processing Segment (IDPS) system. This same RDR science data is distributed through direct broadcast (DB) to DB users for use in their ground processing systems. This J2 GCDB provides the results of the ATMS system radiometric calibration, the antenna flat reflector emissivity [1], the antenna pattern measurements, the antenna pattern corrected brightness temperature [2], the brightness temperature of the lunar disk [3], Lunar Intrusion (LI) correction algorithm [4], receiver spectral parameters, and mechanical alignment on-orbit pointing results, and the striping effect appeared significantly in S-NPP on-orbit radiance data when the data are compared to the Radiative Transfer Model (RTM) simulation in numerical weather prediction (NWP) system [5]. It also provides the parameters required for conversion of telemetry counts to engineering units, for radiometric calibration, and for antenna beam geo-location. Moreover, it provides JPSS-2 ATMS Spectral Response Functions data, some additional information related to ATMS on-orbit performance, on-orbit lunar intrusion correction parameters and Earth contamination bias, and on how to derive ATMS RDR, antenna Temperature Data Records (TDR), and Sensor Data Records (SDR). Furthermore, an introduction of NOAA operational Integrated Calibration and Validation System (ICVS) website and services is added in this J2 GCDB. This ICVS hosts a long-term monitoring system which allows to visualization and comparison of data from JPSS missions, NOAA legacy Polar Operational Environmental Satellites (POES), and Geostationary Operational Environmental Satellites (GOES). From NOAA Comprehensive Large Array-data Stewardship System (CLASS), the public users can download all JPSS ATMS data products for all JPSS missions.

Microwave Sounder↗

Application of flight systems methodologies to the validation of knowledge-based systems

Flight and mission-critical systems are verified, qualified for flight, and validated using well-known and well-established techniques. These techniques define the validation methodology used for such systems. In order to verify, qualify, and validate knowledge-based systems (KBS's), the methodology used for conventional systems must be addressed, and the applicability and limitations of that methodology to KBS's must be identified. An outline of how this approach to the validation of KBS's is being developed and used is presented.

Duke, Eugene L.↗

Application of flight systems methodologies to the validation of knowledge-based systems

Flight and mission-critical systems are verified, qualified for flight, and validated using well-known and well-established techniques. These techniques define the validation methodology used for such systems. In order to verify, qualify, and validate knowledge-based systems (KBS's), the methodology used for conventional systems must be addressed, and the applicability and limitations of that methodology to KBS's must be identified. The author presents an outline of how this approach to the validation of KBS's is being developed and used at the Dryden Flight Research Facility of the NASA Ames Research Center.

Duke, Eugene L.↗

Texture measurements on quartz single crystals to validate coordinate systems for neutron time-of-flight texture analysis

In crystallographic texture analysis, ensuring that sample directions are preserved from experiment to the resulting orientation distribution is crucial to obtain physical meaning from diffraction data. This work details a procedure to ensure instrument and sample coordinates are consistent when analyzing diffraction data with a Rietveld refinement using the texture analysis software MAUD . A quartz crystal is measured on the HIPPO diffractometer at Los Alamos National Laboratory for this purpose. The methods described here can be applied to any diffraction instrument measuring orientation distributions in polycrystalline materials.

36 MATERIALS SCIENCE↗

Statistical modeling of software reliability

This working paper discusses the statistical simulation part of a controlled software development experiment being conducted under the direction of the System Validation Methods Branch, Information Systems Division, NASA Langley Research Center. The experiment uses guidance and control software (GCS) aboard a fictitious planetary landing spacecraft: real-time control software operating on a transient mission. Software execution is simulated to study the statistical aspects of reliability and other failure characteristics of the software during development, testing, and random usage. Quantification of software reliability is a major goal. Various reliability concepts are discussed. Experiments are described for performing simulations and collecting appropriate simulated software performance and failure data. This data is then used to make statistical inferences about the quality of the software development and verification processes as well as inferences about the reliability of software versions and reliability growth under random testing and debugging.

Miller, Douglas R.↗

A psychologist's view of validating aviation systems

All systems, no matter what they are designed to do, have shortcomings that may make them less productive than was hoped during the initial development. Such shortcomings can arise at any stage of development: from conception to the end of the implementation life cycle. While systems failure and errors of a lesser magnitude can occur as a function of mechanical or software breakdown, the majority of such problems, in aviation are usually laid on the shoulders of the human operator and, to a lesser extent, on human factors. The operator bears the responsibility and blame even though, from a human factors perspective, error may have been designed into the system. Human factors is not a new concept in aviation. The name may be new, but the issues related to operators in the loop date back to the industrial revolution of the nineteenth century and certainly to the aviation build-up for World War I. During this first global confrontation, military services from all sides discovered rather quickly that poor selection and training led to drastically increased personnel losses. While hardware design became an issue later, the early efforts were primarily focused on increased care in pilot selection and on their training. This actually involved early labor-intensive simulation, using such devices as sticks and chairs mounted on rope networks which could be manually moved in response to control input. The use of selection criteria and improved training led to more viable person-machine systems. More pilots survived training and their first ten missions in the air, a rule of thumb arrived at by experience which predicted ultimate survival better than any other. This rule was to hold through World War II. At that time, personnel selection and training became very sophisticated based on previous standards. Also, many psychologists were drafted into Army Air Corps programs which were geared towards refining the human factor. However, despite the talent involved in these programs and the tremendous build-up of aviation during the war, there were still aircraft designs that were man killers (no sexism implied since all combat pilots were men). One classic design error that was identified fifty years ago was the multipointer altimeter, which could easily be misread especially by a pilot under considerable task load. It has led to flying fully operational aircraft into the terrain. The authors of the research which formally identified this problem put 'Human Errors' in quotes to express their dissatisfaction with the traditional approach to accident investigation. It traditionally places the burden of guilt on the operator. Some of these altimeters still exist in older aircraft to this day.

Stein, Earl S.↗