Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “automated verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Combining real-time monitoring and knowledge-based analysis in MARVEL

Real-time artificial intelligence is gaining increasing attention for applications in which conventional software methods are unable to meet technology needs. One such application area is the monitoring and analysis of complex systems. MARVEL, a distributed monitoring and analysis tool with multiple expert systems, was developed and successfully applied to the automation of interplanetary spacecraft operations at NASA's Jet Propulsion Laboratory. MARVEL implementation and verification approaches, the MARVEL architecture, and the specific benefits that were realized by using MARVEL in operations are described.

Schwuttke, Ursula M.↗

Active control of instabilities in laminar boundary-layer flow. Part 1: An overview

This paper (the first in a series) focuses on using active-control methods to maintain laminar flow in a region of the flow in which the natural instabilities, if left unattended, lead to turbulent flow. The authors review previous studies that examine wave cancellation (currently the most prominent method) and solve the unsteady, nonlinear Navier-Stokes equations to evaluate this method of controlling instabilities. It is definitely shown that instabilities are controlled by the linear summation of waves (i.e., wave cancellation). Although a mathematically complete method for controlling arbitrary instabilities has been developed (but not yet tested), the review, duplication, and physical explanation of previous studies are important steps for providing an independent verification of those studies, for establishing a framework for subsequent work which will involve automated transition control, and for detailing the phenomena by which the automated studies can be used to expand knowledge of flow control.

Joslin, Ronald D.↗

Active Control of Instabilities in Laminar Boundary Layers-Overview and Concept Validation

This paper (the first in a series) focuses on using active-control methods to maintain laminar flow in a region of the flow in which the natural instabilities, if left unattended, lead to turbulent flow. The authors review previous studies that examine wave cancellation (currently the most prominent method) and solve the unsteady, nonlinear Navier-Stokes equations to evaluate this method of controlling instabilities. It is definitively shown that instabilities are controlled by the linear summation of waves (i.e., wave cancellation). Although a mathematically complete method for controlling arbitrary instabilities has been developed, the review, duplication, and physical explanation of previous studies are important steps for providing an independent verification of those studies, for establishing a framework for the work which will involve automated transition control, and for detailing the phenomena by-which the automated studies can be used to expand knowledge of flow control.

Joslin, Ronald D.↗

Fault management for the Space Station Freedom control center

This paper describes model based reasoning fault isolation in complex systems using automated digraph analysis. It discusses the use of the digraph representation as the paradigm for modeling physical systems and a method for executing these failure models to provide real-time failure analysis. It also discusses the generality, ease of development and maintenance, complexity management, and susceptibility to verification and validation of digraph failure models. It specifically describes how a NASA-developed digraph evaluation tool and an automated process working with that tool can identify failures in a monitored system when supplied with one or more fault indications. This approach is well suited to commercial applications of real-time failure analysis in complex systems because it is both powerful and cost effective.

Clark, Colin↗

Independent Verification and Validation of Complex User Interfaces: A Human Factors Approach

The Usability Testing and Analysis Facility (UTAF) at the NASA Johnson Space Center has identified and evaluated a potential automated software interface inspection tool capable of assessing the degree to which space-related critical and high-risk software system user interfaces meet objective human factors standards across each NASA program and project. Testing consisted of two distinct phases. Phase 1 compared analysis times and similarity of results for the automated tool and for human-computer interface (HCI) experts. In Phase 2, HCI experts critiqued the prototype tool's user interface. Based on this evaluation, it appears that a more fully developed version of the tool will be a promising complement to a human factors-oriented independent verification and validation (IV&V) process.

Whitmore, Mihriban↗

Software for Checking Statecharts

HiVy is a software tool set that enables verification through model checking of designs represented as finite-state machines or statecharts. HiVy provides automated translation of (1) statecharts created by use of the MathWorks Stateflow program to (2) Promela, the input language of the Spin model checker, which can then be used to verify, or trace logical errors in, distributed software systems. HiVy can operate directly on Stateflow models, or its abstract syntax of hierarchical sequential automata (HSA) can be used independently as an intermediate format for translation to Promela. In a typical design application, HiVy parses and reformats Stateflow model file data using the programs SfParse and sf2hsa, respectively. If the parsing effort is successful, an abstract syntax tree is delivered into a file named with the extension .hsa. If the design comprises several model files, they may be merged into one .hsa file before translation into Promela. Stateflow scope is preserved, and name clashes are avoided in the merge process. The HiVy program hsa2pr translates the model from the intermediate HSA format into Promela. Additionally, HiVy provides through translation a list of all statechart model propositions that are the means for formalizing linear temporal logic (LTL) properties about the model for Spin verification.

Pingree, Paula↗

Propel: Tools and Methods for Practical Source Code Model Checking

The work reported here is an overview and snapshot of a project to develop practical model checking tools for in-the-loop verification of NASA s mission-critical, multithreaded programs in Java and C++. Our strategy is to develop and evaluate both a design concept that enables the application of model checking technology to C++ and Java, and a model checking toolset for C++ and Java. The design concept and the associated model checking toolset is called Propel. It builds upon the Java PathFinder (JPF) tool, an explicit state model checker for Java applications developed by the Automated Software Engineering group at NASA Ames Research Center. The design concept that we are developing is Design for Verification (D4V). This is an adaption of existing best design practices that has the desired side-effect of enhancing verifiability by improving modularity and decreasing accidental complexity. D4V, we believe, enhances the applicability of a variety of V&V approaches; we are developing the concept in the context of model checking. The model checking toolset, Propel, is based on extending JPF to handle C++. Our principal tasks in developing the toolset are to build a translator from C++ to Java, productize JPF, and evaluate the toolset in the context of D4V. Through all these tasks we are testing Propel capabilities on customer applications.

Mansouri-Samani, Massoud↗

Verification and Validation in a Rapid Software Development Process

The high cost of software production is driving development organizations to adopt more automated design and analysis methods such as rapid prototyping, computer-aided software engineering (CASE) tools, and high-level code generators. Even developers of safety-critical software system have adopted many of these new methods while striving to achieve high levels Of quality and reliability. While these new methods may enhance productivity and quality in many cases, we examine some of the risks involved in the use of new methods in safety-critical contexts. We examine a case study involving the use of a CASE tool that automatically generates code from high-level system designs. We show that while high-level testing on the system structure is highly desirable, significant risks exist in the automatically generated code and in re-validating releases of the generated code after subsequent design changes. We identify these risks and suggest process improvements that retain the advantages of rapid, automated development methods within the quality and reliability contexts of safety-critical projects.

Callahan, John R.↗

LLRF commissioning of the CEBAF C75 upgrades SAM 2024/25

An often-overlooked aspect of Low Level Radio Frequency (LLRF) design is commissioning of a new system. During Jlab’s Scheduled Accelerator Maintenance (SAM) in 2024, two C75 Cryomodule were installed in CEBAF with Jlab’s LLRF 3.0 system. Jlab’s team has invested effort in automating and standardizing their commissioning process. Several key components are klystron characterization, cavity characterization, and interlock verification. This poster will present the summary of LLRF preparation and commissioning efforts at Jlab.

Accelerator Physics↗

CADAT integrated circuit mask analysis

CADAT System Mask Analysis Program (MAPS2) is automated software tool for analyzing integrated-circuit mask design. Included in MAPS2 functions are artwork verification, device identification, nodal analysis, capacitance calculation, and logic equation generation.

Source record↗

Engine condition monitoring: CF6 family 60's through the 80's

The on condition program is described in terms of its effectiveness as a maintenance tool both at the line station as well as at home base by the early detection of engine faults, erroneous instrumentation signals and by verification of engine health. The system encompasses all known methods from manual procedures to the fully automated airborne integrated data system.

Kent, H. J.↗

Expert system verification and validation study. Delivery 3A and 3B: Trip summaries

Key results are documented from attending the 4th workshop on verification, validation, and testing. The most interesting part of the workshop was when representatives from the U.S., Japan, and Europe presented surveys of VV&T within their respective regions. Another interesting part focused on current efforts to define industry standards for artificial intelligence and how that might affect approaches to VV&T of expert systems. The next part of the workshop focused on VV&T methods of applying mathematical techniques to verification of rule bases and techniques for capturing information relating to the process of developing software. The final part focused on software tools. A summary is also presented of the EPRI conference on 'Methodologies, Tools, and Standards for Cost Effective Reliable Software Verification and Validation. The conference was divided into discussion sessions on the following issues: development process, automated tools, software reliability, methods, standards, and cost/benefit considerations.

French, Scott↗

An Overview of SAL

To become practical for assurance, automated formal methods must be made more scalable, automatic, and cost-effective. Such an increase in scope, scale, automation, and utility can be derived from an emphasis on a systematic separation of concerns during verification. SAL (Symbolic Analysis Laboratory) attempts to address these issues. It is a framework for combining different tools to calculate properties of concurrent systems. The heart of SAL is a language, developed in collaboration with Stanford, Berkeley, and Verimag for specifying concurrent systems in a compositional way. Our instantiation of the SAL framework augments PVS with tools for abstraction, invariant generation, program analysis (such as slicing), theorem proving, and model checking to separate concerns as well as calculate properties (i.e., perform, symbolic analysis) of concurrent systems. We. describe the motivation, the language, the tools, their integration in SAL/PAS, and some preliminary experience of their use.

Bensalem, Saddek↗

Development of Advanced Verification and Validation Procedures and Tools for the Certification of Learning Systems in Aerospace Applications

Adaptive control technologies that incorporate learning algorithms have been proposed to enable automatic flight control and vehicle recovery, autonomous flight, and to maintain vehicle performance in the face of unknown, changing, or poorly defined operating environments. In order for adaptive control systems to be used in safety-critical aerospace applications, they must be proven to be highly safe and reliable. Rigorous methods for adaptive software verification and validation must be developed to ensure that control system software failures will not occur. Of central importance in this regard is the need to establish reliable methods that guarantee convergent learning, rapid convergence (learning) rate, and algorithm stability. This paper presents the major problems of adaptive control systems that use learning to improve performance. The paper then presents the major procedures and tools presently developed or currently being developed to enable the verification, validation, and ultimate certification of these adaptive control systems. These technologies include the application of automated program analysis methods, techniques to improve the learning process, analytical methods to verify stability, methods to automatically synthesize code, simulation and test methods, and tools to provide on-line software assurance.

Jacklin, Stephen↗

NASA SPoRT Modeling and Data Assimilation Research and Transition Activities Using WRF, LIS and GSI

weather research and forecasting ===== The NASA Short‐term Prediction Research and Transition (SPoRT) program has numerous modeling and data assimilation (DA) activities in which the WRF model is a key component. SPoRT generates realtime, research satellite products from the MODIS and VIIRS instruments, making the data available to NOAA/NWS partners running the WRF/EMS, including: (1) 2‐km northwestern‐hemispheric SST composite, (2) daily, MODIS green vegetation fraction (GVF) over CONUS, and (3) NASA Land Information System (LIS) runs of the Noah LSM over the southeastern CONUS. Each of these datasets have been utilized by specific SPoRT partners in local EMS model runs, with select offices evaluating the impacts using a set of automated scripts developed by SPoRT that manage data acquisition and run the NCAR Model Evaluation Tools verification package. SPoRT is engaged in DA research with the Gridpoint Statistical Interpolation (GSI) and Ensemble Kalman Filter in LIS for soil moisture DA. Ongoing DA projects using GSI include comparing the impacts of assimilating Atmospheric Infrared Sounder (AIRS) radiances versus retrieved profiles, and an analysis of extra‐tropical cyclones with intense non‐convective winds. As part of its Early Adopter activities for the NASA Soil Moisture Active Passive (SMAP) mission, SPoRT is conducting bias correction and soil moisture DA within LIS to improve simulations using the NASA Unified‐WRF (NU‐WRF) for both the European Space Agency's Soil Moisture Ocean Salinity and upcoming SMAP mission data. SPoRT has also incorporated real‐time global GVF data into LIS and WRF from the VIIRS product being developed by NOAA/NESDIS. This poster will highlight the research and transition activities SPoRT conducts using WRF, NU‐WRF, EMS, LIS, and GSI.

Case, Jonathan L.↗

Using Empirical Models for Communication Prediction of Spacecraft

A viable communication path to a spacecraft is vital for its successful operation. For human spaceflight, a reliable and predictable communication link between the spacecraft and the ground is essential not only for the safety of the vehicle and the success of the mission, but for the safety of the humans on board as well. However, analytical models of these communication links are challenged by unique characteristics of space and the vehicle itself. For example, effects of radio frequency during high energy solar events while traveling through a solar array of a spacecraft can be difficult to model, and thus to predict. This presentation covers the use of empirical methods of communication link predictions, using the International Space Station (ISS) and its associated historical data as the verification platform and test bed. These empirical methods can then be incorporated into communication prediction and automation tools for the ISS in order to better understand the quality of the communication path given a myriad of variables, including solar array positions, line of site to satellites, position of the sun, and other dynamic structures on the outside of the ISS. The image on the left below show the current analytical model of one of the communication systems on the ISS. The image on the right shows a rudimentary empirical model of the same system based on historical archived data from the ISS.

Quasny, Todd↗

Verification and Validation of Neural Networks for Aerospace Systems

The Dryden Flight Research Center V&V working group and NASA Ames Research Center Automated Software Engineering (ASE) group collaborated to prepare this report. The purpose is to describe V&V processes and methods for certification of neural networks for aerospace applications, particularly adaptive flight control systems like Intelligent Flight Control Systems (IFCS) that use neural networks. This report is divided into the following two sections: Overview of Adaptive Systems and V&V Processes/Methods.

Mackall, Dale↗

Verification and Validation of Neural Networks for Aerospace Systems

The Dryden Flight Research Center V&V working group and NASA Ames Research Center Automated Software Engineering (ASE) group collaborated to prepare this report. The purpose is to describe V&V processes and methods for certification of neural networks for aerospace applications, particularly adaptive flight control systems like Intelligent Flight Control Systems (IFCS) that use neural networks. This report is divided into the following two sections: 1) Overview of Adaptive Systems; and 2) V&V Processes/Methods.

Mackall, Dale↗