Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Secure Naming and Addressing Operations for Store, Carry and Forward Networks

This paper describes concepts for secure naming and addressing directed at Store, Carry and Forward (SCF) distributed applications, where disconnection and intermittent connectivity between forwarding systems is the norm. The paper provides a brief overview of store, carry and forward distributed applications followed by an in depth discussion of how to securely: create a namespace; allocate names within the namespace; query for names known within a local processing system or connected subnetwork; validate ownership of a given name; authenticate data from a given name; and, encrypt data to a given name. Critical issues such as revocation of names, mobility and the ability to use various namespaces to secure operations or for Quality-of-Service are also presented. Although the concepts presented for naming and addressing have been developed for SCF, they are directly applicable to fully connected systems.

computer security↗
DOE OSTI2023

Multiphysics Modeling of Hydrokinetic Turbine Energy Conversion System

Hydrokinetic turbines (HKTs) hold great promise as a renewable energy source, but high maintenance costs and limited energy output hinder their widespread adoption. The lack of comprehensive research on HKT drivetrain designs creates a knowledge gap in enhancing generation efficiency and cost reduction. A model of the HKT system with a focus on electric drivetrains and power converters is required to address this knowledge gap. This paper first introduces a MATLAB-averaged model integrating electrical-mechanical-thermal domains and aging behaviors within multi-time frames. Then a PLECS model, which incorporates maximum power point tracking and dq reference framed control for AC-DC-AC power converters, is enriched by a dynamic thermal model to predict fast transients accurately. These models optimize the design at the component level, resulting in improved integrated system performance. Furthermore, the validation of the models is carried out through hardware experiments for the averaged model and hardware-in-the-loop testing for the dynamic model.

ADVANCED PROPULSION SYSTEMS,HYDRO ENERGY↗
NASA NTRSDate not supplied

Stochastic Verification by Analysis for Autonomous Systems Management Architecture (ASMA)

The Gateway Vehicle Systems Manager (VSM) is the top-level of a distributed, hierarchical software control system. VSM is data-driven and will make decisions related to mission, fault, resource management and vehicle control. These attributes combined with a high degree of autonomy make it susceptible to emergent behavior. In order to achieve the high level of confidence needed in this critical system, the VSM team has developed a multifaceted verification strategy employing traditional verification techniques, simulation, model checking, and runtime verification. Individual algorithms are verified using conventional testing and model checking using assume-guarantee contracts. A discrete event-based simulation approach is being developed to verify timelines. This presentation describes an enhancement to the verification approach using analysis to enhance system robustness by detecting and resolving the potential for emergent behavior. The verification by analysis employs a Software in the Loop (SITL) environment with real flight software executing on emulated processors, simulations of vehicle subsystems, flight dynamics, and human inputs. Since the possible input space and configuration data set are too large for exhaustive testing, a Monte Carlo approach is used to cover feasible scenarios, augmented with corner cases and known higher-risk scenarios. A key problem in using Monte Carlo-based system verification is evaluating test results to ensure that system behavior is correct. The presentation describes the approach the VSM team uses to monitor behavior for compliance with predetermined boundaries and to identify anomalous behavior for further analysis. This presentation describes the multi-level systems approach to verification, and the simulation-based layer that covers the feasible state space: 1. Overview of the Gateway VSM 2. Special challenges due to heterogeneous, hierarchical architecture 3. Modeling and simulation environment using flight software and system simulations 4. Developing input sets to ensure state-space coverage 5. Developing model and data configuration sets to ensure model coverage 6. Interpreting results without predetermined outcomes 7. Lessons learned and future work

Verification and Validation↗
NASA NTRS2009

Sensor System Performance Evaluation and Benefits from the NPOESS Airborne Sounder Testbed-Interferometer (NAST-I)

Advanced satellite sensors are tasked with improving global-scale measurements of the Earth's atmosphere, clouds, and surface to enable enhancements in weather prediction, climate monitoring, and environmental change detection. Validation of the entire measurement system is crucial to achieving this goal and thus maximizing research and operational utility of resultant data. Field campaigns employing satellite under-flights with well-calibrated FTS sensors aboard high-altitude aircraft are an essential part of this validation task. The National Polar-orbiting Operational Environmental Satellite System (NPOESS) Airborne Sounder Testbed-Interferometer (NAST-I) has been a fundamental contributor in this area by providing coincident high spectral/spatial resolution observations of infrared spectral radiances along with independently-retrieved geophysical products for comparison with like products from satellite sensors being validated. This paper focuses on some of the challenges associated with validating advanced atmospheric sounders and the benefits obtained from employing airborne interferometers such as the NAST-I. Select results from underflights of the Aqua Atmospheric InfraRed Sounder (AIRS) and the Infrared Atmospheric Sounding Interferometer (IASI) obtained during recent field campaigns will be presented.

Larar, A.↗
DOE OSTI2023

Spatio-Temporal Deep Graph Network for Event Detection, Localization, and Classification in Cyber-Physical Electric Distribution System

This work proposes a deep graph learning framework to identify, locate, and classify power, cyber, and cyber power events at the distribution system level. The proposed algorithm jointly exploits spatial, temporal, and node-level cyber and physical data features. The developed graph neural network, together with a deep autoencoder, utilizes physical measurements from distribution level phasor measurement units and cyber data from communication network logs. The spatial structure of the synchrophasor measurements and network is incorporated through a weighted adjacency matrix. The temporal structure is incorporated by defining a spatial operation in the gated recurrent unit. This spatio-temporal learning element resides inside a power event detection, localization, and classification module that provides the degree of confidence for an event label. To accurately pinpoint the location of an event to the nearest bus equipped with a measurement unit, a combination of squared error and proximity score is utilized. Also included is a cyber event detection module that employs heteroskedasticity to analyze the significance of various cyber features during different types of attacks. Finally, a dual-bit cyber-power decision table determines the nature of the event. The proposed method is validated on two distribution systems modeled in OPAL-RT/Hypersim with limited phasor measurement units for different possible physical and cyber events. Further analyses include comparison with other state-of-the-art methods and validation in the presence of measurement noise. As a result, our method outperforms existing approaches and achieves an average detection accuracy of 97.97%, F1-score of 96.88%, precision of 96.53%, and recall of 98.57%.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1986

Transformation of two and three-dimensional regions by elliptic systems

Efforts in transferring computational work from the LRC computer to the IRIS Graphics Workstation at MSU are reported and the computation of a conservative solution of a simple hyperbolic equation on an overlapping grid is discussed. Several conclusions concerning computations on overlapping grids are apparent. Problems only occur when there is a major difference in grid spacing on the individual component grids. In the case of hyperbolic equations, it is necessary that both interpolation and extrapolation be applied at the grid boundaries. When interpolated values are used at outflow boundary points, excessive oscillations in the numerical solution may be the result. The same conclusions would be valid for more complicated systems of hyperbolic equations such as the Euler equations for inviscid flow. Some of the solution values would be extrapolated at the overlap boundary, the exact number depending on the number of characteristics pointing out of the overlap region. It is also possible that similar boundary conditions may be needed for some parabolic equations such as high Reynolds number viscous flow equations. Efforts were also expended on the development of three-dimensional conservative interpolation procedures. Finally, the investigation of grid smoothing procedures were initiated during this reporting period. It was decided that the first grid smoothing algorithms will be based on the concepts of variational grid generation.

Mastin, C. W.↗
DOE OSTI2020

A Relaxed PV Bus Model in Linear Power Flow

The emerging multimodal active energy resource units make it necessary to introduce constant voltage amplitude buses (PV bus) in the operation of modern distribution systems. To enable the analysis of PV bus using linear power flow models, this letter proposes a relaxed PV bus model for solving power flow related problems using an indirect modeling approach. The developed PV bus model can be applied to linear power flow models in both rectangular and polar coordinates. Besides, the approximation error of the relaxed PV bus model can also be controlled and quantified. Lastly, the proposed relaxed PV bus model is validated using different test systems. According to the numerical studies, the maximum error on the PV bus approximation in all case studies is only 0.61%, and the maximum error of the supporting power at the PV buses is 6.5%.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Optimal Realization of Yang–Baxter Gate on Quantum Computers

Quantum computers provide a promising method to study the dynamics of many-body systems beyond classical simulation. On the other hand, the analytical methods developed and results obtained from the integrable systems provide deep insights on the many-body system. Quantum simulation of the integrable system not only provides a valid benchmark for quantum computers but is also the first step in studying integrable-breaking systems. The building block for the simulation of an integrable system is the Yang–Baxter gate. It is vital to know how to optimally realize the Yang–Baxter gates on quantum computers. Based on the geometric picture of the Yang–Baxter gates, the optimal realizations of two types of Yang–Baxter gates with a minimal number of controlled NOT (CNOT) or gates are presented. It is also shown how to systematically realize the Yang–Baxter gates via the pulse control. The different realizations on IBM quantum computers are tested and compared. It is found that the pulse realizations of the Yang–Baxter gates always have a higher gate fidelity compared to the optimal CNOT or realizations. On the basis of the above optimal realizations, the simulation of the Yang–Baxter equation on quantum computers is demonstrated. Finally, these results provide a guideline and standard for further experimental studies based on the Yang–Baxter gate.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Verification of a Modeling Toolkit for the Design of Building Electrical Distribution Systems

DC electrical distribution systems offer many potential advantages over their AC counterparts. They can facilitate easier integration with distributed energy resources, improve system energy efficiency by eliminating AC/DC converters at end-use devices (e.g., laptop chargers), and reduce installation material, time, and cost. However, DC electrical distribution systems present additional design considerations, largely resulting from potentially greater magnitude and variation in cable losses. Modeling and simulation are rarely used to design such systems. However, the greater dependency of DC system energy efficiency on design choices such as distribution voltages, architecture, and integration of PV and BESS suggests that modeling and simulation may be required. Such system performance analysis is currently not a standard practice, in part due to limited availability and validation of capable software tools. This paper characterizes the accuracy of a Modelica-based Building Electrical Efficiency Analysis Model (BEEAM) toolkit, as a precursor for validating its use to perform system performance analysis and inform design decisions. The study builds upon previous verification research by characterizing complete systems comprised of commercially available equipment, and providing a more detailed analysis of simulation results. Five lighting systems with varying electrical distribution architectures were designed using market-available equipment, installed in a laboratory environment, modeled using BEEAM, and simulated using three Modelica integrated development environments (IDEs). Simulated and measured results were compared to characterize toolkit accuracy. Initial results revealed that simulated performance was mostly within ±5% of measured system-level and device-level performance. While simulation results were not found to be dependent on the IDE, some Modelica compiler interoperability issues were identified. Although the BEEAM toolkit showed promise for the targeted use case, further work is needed to determine whether the demonstrated 5% accuracy is sufficient for making real-world design decisions, and for BEEAM to advance from an interesting research tool to one that can impact real-world building projects.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1990

Rule groupings in expert systems

Currently, expert system shells do not address software engineering issues for developing or maintaining expert systems. As a result, large expert systems tend to be incomprehensible, difficult to debug or modify, and almost impossible to verify or validate Partitioning rule-based systems into rule groups which reflect the underlying subdomains of the problem should enhance the comprehensibility, maintainability, and reliability of expert-system software. In this paper, we investigate methods to semi-automatically structure a CLIPS rule base e into groups of rules that carry related information. We discuss three different distance metrics for measuring the relatedness of rules and describe two clustering algorithms based on these distance metrics. The results of our experiment with three sample rule bases are also presented.

Mehrotra, Mala↗
NASA NTRS2015

Demonstration of Hybrid Multilayer Insulation for Fixed Thickness Applications

Once on orbit, high performing insulation systems for cryogenic systems need just as good radiation (optical) properties as conduction properties. This requires the use of radiation shields with low conductivity spacers in between. By varying the height and cross-sectional area of the spacers between the radiation shields, the relative radiation and conduction heat transfers can be manipulated. However, in most systems, there is a fixed thickness or volume allocated to the insulation. In order to understand how various combinations of different multilayer insulation (MLI) systems work together and further validate thermal models of such a hybrid MLI set up, test data is needed. The MLI systems include combinations of Load Bearing MLI (LB-MLI) and traditional MLI. To further simulate the space launch vehicle case wherein both ambient pressure and vacuum environments are addressed, different cold-side thermal insulation substrates were included for select tests.

Cryogenic Fluid Management↗
NASA NTRS2022

Evaluating the Calibration and Validation of the Clouds and the Earth’s Radiant Energy System (CERES) instruments on Terra and Aqua Over Twenty Years

Six Clouds and the Earth’s Radiant Energy System (CERES) instruments on four satellites are used to produce a global continuous multi-decadal record of Earth’s radiation budget (ERB) at the top-of-atmosphere (TOA). Each CERES instrument was calibrated and characterized on the ground before launch, while post-launch calibration is conducted using on-board calibration sources. The performance of the CERES instruments is verified using vicarious approaches involving both Earth and celestial targets. In this paper, we describe the calibration and validation approach and demonstrate the performance of the CERES instruments on the Terra and Aqua spacecrafts over the twenty-year period since launch. Validation results demonstrate that after applying the appropriate calibration corrections, all four instruments are stable and perform consistently with each other. Comparisons of observations between instruments on the two spacecrafts during orbital crossings further confirm the consistent performance across all instruments over the twenty year period.

Terra↗
NASA NTRS2014

The Evolution of System Safety at NASA

The NASA system safety framework is in the process of change, motivated by the desire to promote an objectives-driven approach to system safety that explicitly focuses system safety efforts on system-level safety performance, and serves to unify, in a purposeful manner, safety-related activities that otherwise might be done in a way that results in gaps, redundancies, or unnecessary work. An objectives-driven approach to system safety affords more flexibility to determine, on a system-specific basis, the means by which adequate safety is achieved and verified. Such flexibility and efficiency is becoming increasingly important in the face of evolving engineering modalities and acquisition models, where, for example, NASA will increasingly rely on commercial providers for transportation services to low-earth orbit. A key element of this objectives-driven approach is the use of the risk-informed safety case (RISC): a structured argument, supported by a body of evidence, that provides a compelling, comprehensible and valid case that a system is or will be adequately safe for a given application in a given environment. The RISC addresses each of the objectives defined for the system, providing a rational basis for making informed risk acceptance decisions at relevant decision points in the system life cycle.

Dezfuli, Homayoon↗
DOE OSTI2021

Integration of Dynamical System Scaling to RAVEN and Facility Application

As part of the design optimization and model validation effort within the hybrid energy systems program, the research to implement dynamical system scaling (DSS) code to RAVEN is funded under the Integrated Energy System program in collaboration with the Digital Reactor Technology & Development department. The DSS data processing algorithm has been coded within the RAVEN framework along with other metrics and postprocessing models. The implemented code was tested using a gravity-driven draining tank draining case modeled in RELAP5-3D and generated data was successfully postprocessed based on the scaling analyses defined by DSS. Postprocessed data concluded less agreement for the tank exit velocity and indicated that the modeled input deck for RELAP5-3D requires modification to enforce minimal pressure differential effects to the draining process.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1995

System results from FRECOPA

The work carried out over the past three years on FRECOPA and the LDEF has enabled a large quantity of information to be collected, part of which has already been exploited. As far as CNES is concerned, the major spin-offs of this mission mainly focus on the orbital environment and the behavior of materials in such an environment. With respect to the environment, the authors shall develop the lessons learned from expert appraisals on impacts by microparticles, which are the main feature observed in this area. As for the materials, the results show a variety of behavior when subjected to the space environment and even now constitute a wealth of information for the designing and validation of future mechanical systems. Apart from these direct spin-offs, there are repercussions on in-flight and ground testing, the calibration of test benches and improvements to simulation models.

Durin, Christian↗
NASA NTRS2009

Development of a Methodology to Gather Seated Anthropometry in a Microgravity Environment

The Constellation Program's Crew Exploration Vehicle (CEV) is required to accommodate the full population range of crewmembers according to the anthropometry requirements stated in the Human-Systems Integration Requirement (HSIR) document (CxP70024). Seated height is one of many critical dimensions of importance to the CEV designers in determining the optimum seat configuration in the vehicle. Changes in seated height may have a large impact to the design, accommodation, and safety of the crewmembers. Seated height can change due to elongation of the spine when crewmembers are exposed to microgravity. Spinal elongation is the straightening of the natural curvature of the spine and the expansion of inter-vertebral disks. This straightening occurs due to fluid shifts in the body and the lack of compressive forces on the spinal vertebrae. Previous studies have shown that as the natural curvature of the spine straightens, an increase in overall height of 3% of stature occurs which has been the basis of the current HSIR requirements. However due to variations in the torso/leg ratio and impact of soft tissue, data is nonexistent as to how spinal elongation specifically affects the measurement of seated height. In order to obtain this data, an experiment was designed to collect spinal elongation data while in a seated posture in microgravity. The purpose of this study was to provide quantitative data that represents the amount of change that occurs in seated height due to spinal elongation in microgravity environments. Given the schedule and budget constraints of ISS and Shuttle missions and the uniqueness of the problem, a methodology had to be developed to ensure that the seated height measurements were accurately collected. Therefore, simulated microgravity evaluations were conducted to test the methodology and procedures of the experiment. This evaluation obtained seat pan pressure and seated height data to a) ensure that the lap restraint provided sufficient restraint to eliminate any gap between the subject s gluteal surface and the seat pan and b) to document any necessary design and procedural changes needed due to the microgravity environment. The methodology and setup used during the simulated microgravity evaluations was replicable to the proposed methodology and setup for in-space missions. A flight-like Shuttle seat, pressure sensors, anthropometer, and existing hardware was used to measure seated height and contact area while experiencing microgravity. The outlying buttock and thigh surface contact areas were collected to determine if the subjects were in contact with the seat pan, while a measurer recorded their seated height with an anthropometer. The Anthropometry and Biomechanics Facility (ABF) completed data collection from three microgravity flights to assess the restraint methods and techniques to be used for the in-flight procedures performed by the crewmembers in orbit. The first flight demonstrated that the restraint system on the seat, used in a nominal configuration, did not sufficiently restrain a person in the seat. The results showed the subjects were not in full contact with the seat pan, resulting in inaccurate sitting height data. Thus, a second flight was conducted to test different restraint system options. The results showed that by 1) changing the restraint system from the nominal 3-points of the 5-point harness, which is used for crewmembers when fully suited with emergency equipment, and 2) rerouting the lap straps around the joint of the backrest, where the backrest and seat pan are joined, resulted in the optimal method to restrain a subject. This rerouting method allowed for the anchor location to change and pull the subjects back into the seat instead of being anchored at the side of the subjects thighs. The results from the third flight validated the final restraint system, which resulted in a verified methodology for collecting seated anthropometry to ultimately determine the amount of spil elongation in a microgravity environment.

Rajulu, Sudhakar↗
DOE OSTI2021

Validation of Maui PSCAD Model: Motivation, Methodology, and Lessons Learned: Preprint

As power systems become increasingly dependent on inverter-based resources, the dominant physical and control interactions that determine system stability may no longer be accurately captured in positive sequence dynamic simulation tools; electromagnetic transient (EMT) simulations may be needed. This paper describes the process of creating and validating an EMT model of the entire Maui island transmission system in PSCAD software. The model is validated against the utility's PSSE model and against field data for an event that consisted of a single-phase fault followed by a generation trip. The methodology and lessons learned are summarized here.

41 EE - Solar Energy Technologies Office (EE-4S)↗
NASA NTRS2010

Epistemic Questions and Answers for Software System Safety

System safety is primarily concerned with epistemic questions, that is, questions concerning knowledge and the degree of confidence that can be placed in that knowledge. For systems with which human experience is long, such as roads, bridges, and mechanical devices, knowledge about what is required to make the systems safe is deep and detailed. High confidence can be placed in the validity of that knowledge. For other systems, however, with which human experience is comparatively short, such as those that rely in part or in whole on software, knowledge about what is required to ensure safety tends to be shallow and general. The confidence that can be placed in the validity of that knowledge is consequently low. In a previous paper, we enumerated a collection of foundational epistemic questions concerning software system safety. In this paper, we review and refine the questions, discuss some difficulties that attend to answering the questions today, and speculate on possible research to improve the situation.

Holloway, C. M.↗