Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Hybrid Heavy Duty Diesel Powertrain for Off-Road Applications (Final Technical/Scientific Report)

In this program, a heavy-duty hybrid powersystem, consisting of a 30% downsized diesel engine and a front-end accessory drive (FEAD) incorporating a high-speed flywheel (HSFW) energy storage system, a mechanical-drive turbocharger (SuperTurbo), and motor-generator units (MGU) was developed and demonstrated. The high efficiency core 13L engine coupled with the hybrid elements was physically validated across various off-road machine and transient work cycles with the ultimate goal of demonstrating 17% efficiency improvement with equivalent transient response as the 18L diesel engine this concept powersystem would replace. The project culminated in a physical demonstration of the high-efficiency powersystem in a high-capability test cell with the engine, all the hybrid devices, controls, and required performance and emissions measurements. Based on the combination of physical validation and rigorous system simulation, the following program conclusions may be drawn: (1) The developed hybrid H2D2 powersystem demonstrated a range of efficiency improvement of 10.5 - 25.6%, with a midpoint of 17.9%; (2) Transient load response on; (3) The HSFW system was validated to achieve peak assisting of 110kW at 12,000 Nm/sec ramp rates; (4) The powersystem was validated to be capable of meeting U.S. EPA Tier 4 Final off-road emissions through transient NRTC testing; (5) A Total Cost of Ownership (TCO) analysis and found that the core 13L engine would pay back immediately (adoption of start/stop would pay back in less than one year, and the full hybrid system payback was three years.)

33 ADVANCED PROPULSION SYSTEMS↗

A Multi-Sensor Approach for Measuring Bird and Bat Collisions with Offshore Wind Turbines (Final Technical Report)

Collision of birds and bats with wind turbines is a conservation concern for both land-based and offshore wind projects. The fatality rates of birds and bats at land-based turbines are well documented. The measurement strategies on land focus on finding carcasses following collision, estimating the number of carcasses missed through searcher efficiency, carcass persistence trials and carcass fall distributions, and modeling statistically robust fatality rates. Few technologies have been developed to monitor offshore bird and bat collisions, and many that have been developed focused on detecting collisions with large birds. The few studies that have attempted to document collisions at offshore turbines do not account for smaller bodied animals or for collisions that might be missed, which prevents the calculation of statistically robust fatality rates. The overall goal of this report, A Multi-Sensor Approach for Measuring Bird and Bat Collisions with Offshore Wind Turbines (Project), was to develop an effective multi-sensor system for quantifying bird and bat collision rates, specifically for offshore wind facilities. The Project goal and resulting automated collision detection system was achieved through two major technological advancements: 1) refining The Netherlands Organisation for Applied Scientific Research’s (TNO’s) existing WT-Bird® vibration sensing system, that had successfully detected large bird collisions during daytime, to allow for improved detection of smaller birds and bats during both daytime and nighttime hours and 2) improving image processing systems and developing and integrating machine learning algorithms to automatically detect and classify small and large bird and bat collisions with offshore turbines. This final technical report (FTR) summarizes Methods , Results , Conclusions , and Lessons Learned during each of the five Tasks identified for this research and development effort. This FTR includes summaries of the following: Task 1. Initial Engineering Tests to Improve WT-Bird® Task 2. Installation of WT‐Bird® on a Utility-scale Turbine at the National Wind Technology Center – National Renewable Energy Laboratory Task 3. Field Tests and Refinement of the Object Detection System Task 4. Validation of WT-Bird® on a Land-based Turbine Task 5. Preparation for the Implementation of WT-Bird® on an Offshore Turbine. This research and development effort documented successful improvement of the WT Bird® collision detection system to detect small birds and bats, and WT-Bird® is the first collision detection system to validate results compared to land-based post-construction monitoring. The collision trials provide estimates of missed targets that can be used to estimate fatality rates, a significant improvement relative to other offshore collision monitoring systems. Advances were made in developing an edge-processing solution to reduce data storage requirements, which is important if the system is deployed for long periods of time at offshore turbines. The improved WT-Bird® system also provides an important option for wind operators on land or offshore who need to document specific details about when collisions occur, particularly efforts to further research on bat impact minimization, or when standard fatality searches are impractical (e.g. offshore) or inadequate (e.g. challenging locations on land).

17 WIND ENERGY↗

System diagnostic builder

The System Diagnostic Builder (SDB) is an automated software verification and validation tool using state-of-the-art Artificial Intelligence (AI) technologies. The SDB is used extensively by project BURKE at NASA-JSC as one component of a software re-engineering toolkit. The SDB is applicable to any government or commercial organization which performs verification and validation tasks. The SDB has an X-window interface, which allows the user to 'train' a set of rules for use in a rule-based evaluator. The interface has a window that allows the user to plot up to five data parameters (attributes) at a time. Using these plots and a mouse, the user can identify and classify a particular behavior of the subject software. Once the user has identified the general behavior patterns of the software, he can train a set of rules to represent his knowledge of that behavior. The training process builds rules and fuzzy sets to use in the evaluator. The fuzzy sets classify those data points not clearly identified as a particular classification. Once an initial set of rules is trained, each additional data set given to the SDB will be used by a machine learning mechanism to refine the rules and fuzzy sets. This is a passive process and, therefore, it does not require any additional operator time. The evaluation component of the SDB can be used to validate a single software system using some number of different data sets, such as a simulator. Moreover, it can be used to validate software systems which have been re-engineered from one language and design methodology to a totally new implementation.

Nieten, Joseph L.↗

EMPIRICAL VALIDATION OF MULTI-ZONE BUILDING AND HVAC SYSTEM MODELS UNDER UNCERTAINTY

This study implemented a framework of empirical validation of building energy models under uncertainty to a set of controlled experiments that aim to validate multi-zone building and HVAC system models. Energy models were created through iterative acquisitions of information and data and uses measurement data from various types of sensors as both inputs and as observations to validate predictions. Experimental and modeling uncertainties were quantified and propagated accordingly, and probabilistic accuracy metrics were used to evaluate the agreement between model predictions and observations under uncertainty. Sensitivity analysis was performed to identify the most influential uncertainties that will be prioritized to be addressed in the next steps. Current results of two cooling tests show an overall good agreement between predictions and observations on a set of HVAC system outputs despite considerable and influential uncertainty in DX cooling coil COP. Agreements on zone-level responses vary notably among individual rooms, likely because of significant uncertainties in room radiation heat gain and system supply air.

Li, Qi↗

Validation of the NASA Electrical Power System – Sizing and Analysis Tool (EPS-SAT)

The electrification of aircraft propulsion systems has opened the design space for engineers by allowing for unique and highly specialized propulsion system and vehicle designs. NASA developed the Electrical Power System – Sizing and Analysis Tool (EPS-SAT) to conduct high-level trade studies and sensitivity studies on the various propulsion system designs that can be implemented in electrified aircraft. The results of these studies would be used to better direct investment dollars and determine strengths and weaknesses of propulsion system designs. In this paper, the results of the EPS-SAT tool were validated with hardware data extracted from the NASA Revolutionary Vertical Lift Technology (RVLT) Advanced Reconfigurable Electric Aircraft Lab (AREAL). Updated performance maps were added to the EPS-SAT library so that high-fidelity results could be calculated.

Patrick A. Hanlon↗

Traffic Management Advisor: Iterative Field Development and Assessment at Multiple Sites

Previous studies have demonstrated the necessity of involving users in the development of automation aids, especially for complex domains such as air traffic control (ATC). Traditional development only demanded a single field test to validate a completed system, but a more iterative combination of development and assessment ensures that the technology meets the requirements of its application domain. Exposure across an adequate spectrum of field users is also required during development, and the use of multiple development sites provides an opportunity to consider individual facility cultures as they relate to implementation strategies. The development of the Center/TRACON Automation System (CTAS) Traffic Management Advisor (TMA) at the Denver and Dallas ATC facilities demonstrates successful iterative development and assessment at multiple field sites. The use of field development changes the nature of assessment. As development progresses, periodic assessments are required to validate that system development is progressing along an appropriate track. In the development of the TMA, assessments were performed based on software in the field, and input from traffic managers was analyzed and incorporated into subsequent releases of the TMA, to be reassessed in the field. This has led to a tool with operational suitability and broad user acceptance. Assessment at multiple sites provides a more generalizable perspective that allows the production of a system that is both generic enough to be used at different sites and tailored enough to be of use at any site. In addition to providing a better understanding of specific facility requirements, the use of multiple assessment sites in the development of TMA has provided an opportunity to consider individual facility operations, procedures and cultures as they relate to development and implementation strategies.

Sanford, Beverly D.↗

Validation of Synthetic U.S. Electric Power Distribution System Data Sets

There is a strong need for synthetic yet realistic distribution system test data sets that are as diverse, large, and complex to solve as real systems. Such data sets can facilitate the development of advanced algorithms and the assessment of emerging distributed energy resources while avoiding the need to acquire proprietary critical infrastructure or private data. Such synthetic data sets, however, are useful only if they are realistic enough to look and behave similarly to actual systems. This paper presents a comprehensive framework for validating synthetic distribution data sets using a three-pronged statistical, operational, and expert validation approach. Furthermore, it also presents a set of statistical and operational metric targets for achieving realistic data sets based on detailed characterization of more than 10,000 real U.S. utility feeders. The paper demonstrates the use of the proposed validation approach to validate three large-scale synthetic data sets developed by the authors representing Santa Fe, New Mexico; Greensboro, North Carolina; and the San Francisco Bay Area, California.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Use of Grid-Forming Medium-Voltage Power Electronics Hub in a Microgrid Setting

This paper presents the application of a new design of a multiport, modular, medium-voltage power electronics hub (M3PE-HUB) in a microgrid setting. The M3PE-HUB system was modeled in a digital real-time simulator (DRTS) and integrated into the Banshee microgrid test system. This paper presents the preliminary DRTS simulation-based results of the M3PE-HUB system connected in a test microgrid system. Verification and validation of the M3PE-HUB architecture and controls in the test microgrid setting are the primary contributions of this work. The results of the operation during the islanding and resynchronization process indicate the feasibility of the proposed architecture in a microgrid setting. This paper also presents results for a system reconfiguration use case where the M3PE-HUB was used to reconfigure the system under a fault condition.

grid forming↗

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Autonomous Energy Management Software System for Small Commercial Buildings in Support of Decarbonization (Abstract)

The primary goal for the project is to develop and validate an autonomous energy management software (AEMS) system that will continuously optimize small commercial building operations by minimizing energy consumption and cost, providing a solution for maximizing decarbonization benefits from electrification of buildings. The work will leverage vast experience of Pacific Northwest National Laboratory (PNNL) research and development staff who have over two decades of experience in developing and successfully transferring software technologies to the private sector. This solution will be jointly developed with Intellimation LLC who plans to use it to scale their building energy efficiency offering. The project plan will include collaboratively working with Intellimation to package a set of solutions into the AEMS system, validate and demonstrate their capability, and value proposition through field demonstrations. If the deployment of the AEMS system optimizes RTUs’ set points, schedules, setbacks and optimal start and results in energy consumption reduction of 20%, the technical potential savings is approximately 675 trillion Btus of site energy savings and 2,000 trillion Btus of source energy. It will also result in carbon reductions of approximately 2.4 MMTCO2 and contribute to the climate change mitigation plans of many cities and states across the United States. Additional cost savings and emissions reduction are possible from management of peak electricity demand. The primary outcome will be an AEMS system that can be deployed at scale on small commercial buildings to improve operating efficiency.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Robust Compositional Architecture for Autonomous Systems

Space exploration applications can benefit greatly from autonomous systems. Great distances, limited communications and high costs make direct operations impossible while mandating operations reliability and efficiency beyond what traditional commanding can provide. Autonomous systems can improve reliability and enhance spacecraft capability significantly. However, there is reluctance to utilizing autonomous systems. In part this is due to general hesitation about new technologies, but a more tangible concern is that of reliability of predictability of autonomous software. In this paper, we describe ongoing work aimed at increasing robustness and predictability of autonomous software, with the ultimate goal of building trust in such systems. The work combines state-of-the-art technologies and capabilities in autonomous systems with advanced validation and synthesis techniques. The focus of this paper is on the autonomous system architecture that has been defined, and on how it enables the application of validation techniques for resulting autonomous systems.

Brat, Guillaume↗

Field Validation of a Smart Energy Recovery Ventilation System Using Low-Cost Indoor Air Quality Sensors

This project is a field validation, using low-cost indoor air quality (IAQ) sensors, of a smart ventilation system that can help low-load homes in humid environments maintain acceptable indoor humidity conditions while providing adequate ventilation according to ASHRAE 62.2. The objectives of this research were to (1) address builders’ concerns with mechanical ventilation in humid environments and (2) answer the question of whether smart control logic helps with occupant comfort and the creation of a more acceptable indoor environment. To address the objectives of the study, the Southface team collected field data for one year in four Charleston, South Carolina, new construction homes in order to determine the differences in occupant comfort; comfort metrics; IAQ; and heating, ventilating, and air-conditioning (HVAC) energy consumption when toggling biweekly between an energy recovery ventilator (ERV) operating continuously and an ERV operating with smart, time-varying humidity control logic. The smart ventilation algorithm under consideration in this field test did create a less humid indoor environment on an annual basis as quantitatively measured through temperature and relative humidity (T/RH) readings, expressed most discernably as “percentage of time above 60% RH” and “percentage of time above 55°F dewpoint.” However, the difference it made was inconsistent during the spring, summer, and fall months, and it was only directionally consistent during the winter months. We suspect that this is primarily due to the long runtimes and concomitant dehumidification activity of the air-conditioning (A/C) units in response to the high sensible loads in Charleston. The effect of the smart ventilation algorithm was not discernable to the occupants in this study, as recorded through seasonal surveys.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Design and Analysis Techniques for Concurrent Blackboard Systems

Blackboard systems are a natural progression of knowledge-based systems into a more powerful problem solving technique. They provide a way for several highly specialized knowledge sources to cooperate to solve large, complex problems. Blackboard systems incorporate the concepts developed by rule-based and expert systems programmers and include the ability to add conventionally coded knowledge sources. The small and specialized knowledge sources are easier to develop and test, and can be hosted on hardware specifically suited to the task that they are solving. The Formal Model for Blackboard Systems was developed to provide a consistent method for describing a blackboard system. A set of blackboard system design tools has been developed and validated for implementing systems that are expressed using the Formal Model. The tools are used to test and refine a proposed blackboard system design before the design is implemented. My research has shown that the level of independence and specialization of the knowledge sources directly affects the performance of blackboard systems. Using the design, simulation, and analysis tools, I developed a concurrent object-oriented blackboard system that is faster, more efficient, and more powerful than existing systems. The use of the design and analysis tools provided the highly specialized and independent knowledge sources required for my concurrent blackboard system to achieve its design goals.

Mcmanus, John William↗

Satellite retrievals of marine stratiform cloud systems

The initial validation of a satellite-based cloud retrieval scheme of the spatial-coherence type that is being used to create a marine stratiform cloudiness (MSC) climatology is discussed. Initial results are presented which describe correlations between MSC properties and SST, which could be useful for providing guidelines for assessing potential climate feedbacks regarding these cloud types. The correlation of triangle-technique- and spatial-coherence-method-derived fractional cloud covers together with the regression line for all data points is shown.

Molnar, Gyula I.↗

Compartment Venting Analyses of Ares I First Stage Systems Tunnel

Compartment venting analyses have been performed for the Ares I first stage systems tunnel using both the lumped parameter method and the three-dimensional (31)) transient computational fluid dynamics (CFD) approach. The main objective of venting analyses is to predict the magnitudes of differential pressures across the skin so the integrity of solid walls can be evaluated and properly designed. The lumped parameter method assumes the gas pressure and temperature inside the systems tunnel are spatially uniform, which is questionable since the tunnel is about 1,700 in. long and 4 in. wide. Therefore, 31) transient CFD simulations using the commercial CFD code FLUENT are performed in order to examine the gas pressure and temperature variations inside the tunnel. It was found that the uniform pressure and temperature assumptions inside the systems tunnel are valid during ascent. During reentry, the uniform pressure assumption is also reasonable but the uniform temperature assumption is not valid. Predicted pressure and temperature inside the systems tunnel using CFD are also compared with those from the lumped parameter method using the NASA code CHCHVENT. In general, the average pressure and temperature inside the systems tunnel from CFD are between the burst and crush results from CHCHVENT during both ascent and reentry. The skin differential pressure and pressure inside the systems tunnel relative to freestream pressure from CHCHVENT as well as velocity vectors and streamlines are also discussed in detail.

Wang, Qunzhen↗

Design considerations and validation of the MSTAR absolute metrology system

Absolute metrology measures the actual distance between two optical fiducials. A number of methods have been employed, including pulsed time-of-flight, intensity-modulated optical beam, and two-color interferometry. The rms accuracy is currently limited to -5 microns. Resolving the integer number of wavelengths requires a 1-sigma range accuracy of -0.1 microns. Closing this gap has a large pay-off the range (length measurement) accuracy can be increased substantially using the unambiguous optical phase. The MSTAR sensor (Modulation Sideband Technology for Absolute Ranging) is a new system for measuring absolute distance, capable of resolving the integer cycle ambiguity of standard interferometers, and making it possible to measure distance with sub-nanometer accuracy. In this paper, we present recent experiments that use dispersed white light interferometry to independently validate the zero-point of the system. We also describe progress towards reducing the size of optics, and stabilizing the laser wavelength for operation over larger target ranges. MSTAR is a general-purpose tool for conveniently measuring length with much greater accuracy than was previously possible, and has a wide range of possible applications.

Jeganathan, Muthu↗

Architecture of a faul-tolerant and verifiable outer planet flyby

Flyby missions to outer solar system objects require a very high confidence of since there are no second chances. The quantity, quality, and diversity of science measurements to be made in a matter of hours or days must justify the mission cost. Accordingly, the mission architecture must include a high degree of redundancy, large design margins, and an ability to correct or operate through anomalies while at the same time being deterministic enough for confidence in system verification and validation. In this paper we present a system architecture as part of a proposed mission to Triton, called “Trident”.

Mitchell, Karl L.↗