Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software reliability software”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Estimates of software size from state machine designs

The length, or size (in number of Source Lines of Code) of programs represented as state machines, it is demonstrated, can be reliably estimated in terms of the number of internal state machine variables.

Britcher, R. N.↗

Innovative Technology Transfer Partnerships

The National Aeronautics and Space Administration (NASA) seeks to license its Advanced Tire and Strut Pressure Monitor (TSPM) technology. The TSPM is a handheld system to accurately measure tire and strut pressure and temperature over a wide temperature range (20 to 120 OF), as well as improve personnel safety. Sensor accuracy, electronics design, and a simple user interface allow operators quick, easy access to required measurements. The handheld electronics, powered by 12-VAC or by 9-VDC batteries, provide the user with an easy-to-read visual display of pressure/temperature or the streaming of pressure/temperature data via an RS-232 interface. When connected to a laptop computer, this new measurement system can provide users with automated data recording and trending, eliminating the chance for data hand-recording errors. In addition, calibration software allows for calibration data to be automatically utilized for the generation of new data conversion equations, simplifying the calibration processes that are so critical to reliable measurements. The design places a high-accuracy pressure sensor (also used as a temperature sensor) as close to the tire or strut measurement location as possible, allowing the user to make accurate measurements rapidly, minimizing the amount of high-pressure volumes, and allowing reasonable distance between the tire or strut and the operator. The pressure sensor attaches directly to the pressure supply/relief valve on the tire and/or strut, with necessary electronics contained in the handheld enclosure. A software algorithm ensures high accuracy of the device over the wide temperature range. Using the pressure sensor as a temperature sensor permits measurement of the actual temperature of the pressurized gas. This device can be adapted to create a portable calibration standard that does not require thermal conditioning. This allows accurate pressure measurements without disturbing the gas temperature. In-place calibration can save considerable time and money and is suitable in many process applications throughout industry.

Kohler, Jeff↗

Gearbox Reliability Collaborative Phase 3 Gearbox 2 Test

The National Renewable Energy Laboratory (NREL) Gearbox Reliability Collaborative (GRC) was established by the U.S. Department of Energy in 2006; its key goal is to understand the root causes of premature gearbox failures and improve their reliability. The GRC uses a combined gearbox testing, modeling, and analysis approach disseminating data and results to the industry and facilitating improvement of gearbox reliability. This test data describes the tests of GRC gearbox 2 in the National Wind Technology Center dynamometer and documents any modifications to the original test plan. It serves as a guide to interpret the publicly released data sets with brief analyses to illustrate the data. TDMS viewer and Solidworks software required to view data files.

17 WIND ENERGY↗

Austin Sustainable and Holistic Integration of Energy Storage and Solar PV [Austin SHINES]. Final Report, Version 2

The Austin SHINES project and solution is a software management platform, for an electric grid with a high penetration of dispersed photovoltaic (PV) solar generation sites, which maintains the traditional power quality and reliability associated with grid service. This project developed and deployed the platform as a Distributed Energy Resource Management System (DERMS), engaging multiple advanced controls, to evaluate operation and optimization of a fleet of diverse DER assets, installed at several locations among Austin Energy’s customers and distribution system. The project also produced a methodology to create a replicable DERMS template, adaptable to other regions and market structures. Last, Austin SHINES aimed to demonstrate the solution’s methodology would enable the DER grid ecosystem to serve load at a technical cost (System Levelized Cost of Electricity, or System LCOE) of less than the U.S. Department of Energy SHINES program metric of $0.14/kWh, in a defined boundary, while enabling a high penetration of distributed PV. Research was categorized in 6 reports (Final Deliverables = FD) listed below, with titles and descriptions indicating which area of understanding was investigated: FD-1: System Levelized Cost of Electricity (System LCOE) Methodology The creation and use of the System LCOE to Serve Load metric that encompasses the holistic, system-level costs and benefits of all resources, and enables them to be evaluated based on their ability to support an efficient and low-cost integrated grid ecosystem. FD-2: Software Platform Product Description The creation of new DER control methodologies deployable within a utility-grade software platform that enable DER's to maximize their benefit within a grid, that is capable of serving load enabling a high penetration of distributed PV generation. FD-3: Optimal Design Methodology Optimal design methodologies for individual DER installations that enable utilities to determine the optimal combinations and sizing for individual DER sites. FD-4: Austin SHINES Ownership and Operation Models for DER System Performance A comparison of multiple DER aggregation and ownership methodologies including direct utility control, third-party aggregator, and autonomous. FD-5: Economic Modeling & Optimization A comparison of multiple DER technology mixes and configurations within the distribution system, providing insight into an optimal blend of technologies that best enable the distribution system to serve load at the lowest cost at high penetrations of solar. FD-6: Fielded Assets Deployed DER assets within the Austin Energy SHINES circuits. Austin SHINES provided an opening for state-of-the-art technology products to be deployed, providing a rich opportunity for improving how each of the products perform as stand-alone products, and in concert with other complementary products. The Austin SHINES project comprised of two key metrics for System LCOE: SystemLCOE_SHINES<$0.14/kWh Modeled ΔSystemLCOE_SHINES/ΔSystemLCOE_Base≥20% at same solar penetration The System LCOE calculation uses the costs of the utility-owned infrastructure as it exists today, the cost of the DERs that exist in the system today, and the cost of the purchase of energy from ERCOT wholesale markets over the course of the calendar year. All costs are on an annualized basis. The capital and operating costs are derived from the rate case, which produces a yearly cost. The net cost of energy and services imported to the system is integrated over the test year, as is the load served and solar penetration. The first metric was easily achieved by every scenario considered. The goal was set when the Department of Energy’s SHINES Funding Opportunity Announcement was written in 2015 and was a more difficult target at the time. Due mostly to rapidly declining costs for DERs and the significant decrease in the Electric Reliability Council of Texas (ERCOT) energy market prices, which results in lower net cost of energy purchases, the System LCOE is well below this target for all scenarios considered. A fleet of DERs can assume different mixtures, each of which serves the load at a different LCOE. The optimal mixture of DERs serves load at the smallest System LCOE. The second metric (hereinafter %delta metric) asks that the holistic DERMS controls reduce the incremental cost above the baseline of going to a high solar penetration future by at least 20% as compared to the case of a DER deployment with no sophisticated controls (autonomous). Many comparison sets were created throughout this project. Physical technology was installed for informing utility engineering and testing several types of operational control schemes, through the DERMS. The types of operational control which were compared for valuation of the System LCOE Metric were: Holistic control = using the full suite of the DERMS platform to decide and optimize how/why the systems operate depending on weather, market, and reliability signal input. Autonomous control = a local mode at the asset site, wherein a schedule operates the asset, with visibility into performance only No control = the baseline for comparing value against the other two types of control The types of ownership control included: Direct Utility control = the utility dispatches a signal to each asset Third-Party Aggregator = a third party aggregates a fleet of assets and the utility dispatches one signal for all Autonomous = a local mode is set for operation at the asset site, wherein a schedule operates the asset, with visibility into performance only The types of control methodologies deployable within a utility-grade software platform included: Utility Peak Load Reduction = Lower transmission cost obligation Day-Ahead Energy Arbitrage = Realize economic value through price differential Real-Time Price Dispatch = Realize economic value from real-time price spikes Voltage support = Reduce losses and increase solar generation Distribution Congestion Management = Increase local grid reliability Demand Charge Reduction = Lower customer bills and realize system benefit The fielded assets deployed for the project were: Utility Scale Kingsbery Energy Storage System: 1.5 MW / 3 MWh Li-Ion battery storage Mueller Energy Storage System: 1.75 MW / 3.2 MWh Li-Ion battery storage, 7 Energy Storage Units (250 kW each) La Loma Community Solar: 2.6 MW Commercial Scale Aggregated storage installations at 3 sites, with existing solar (300+ kW): One 18 kW / 36 kWh Li-Ion battery storage Two 72 kW / 144 kWh Li-Ion battery storage Residential Scale Aggregated storage installations: -Six stationary battery storage systems (10 kWh each) at homes with existing solar -One Electric Vehicle installed as Vehicle-to-Grid (V2G) Utility-Controlled Solar via Smart Inverters at 12 homes Autonomously-Controlled Smart Inverters at 6 homes Over the course of the project, Austin SHINES undertook installing more than 3 MW of distributed battery energy storage, smart PV inverters, a DER control platform, and other enabling technologies utilizing customer and utility locations and aggregation models. All of these resources were to be integrated and optimized at the utility level. DER assets and control methodologies were designed to achieve a credible pathway to a System LCOE for energy delivered to load of $0.14//kWh or less by 2020, while maximizing distributed solar generation and maintaining acceptable standards of power quality. The project also established a template for other regions to follow, to maximize the adoption of distributed solar PV in support of an economic and efficient grid. In total, the Austin SHINES project added value to the DER subject area in each layer of integration. From utility, to commercial to residential scales, the sheer hierarchy of communication and coordination was a significant accomplishment in addition to learnings from what these communications revealed was unique to each. Economically, the most effective method demonstrated was the criticality of planning phases. Contingencies and multiple projection scenarios helped guide the project to deploy optimal design as close as feasible, in real world conditions. The project and reports will serve public benefit by outlining specific areas of DER strategy and installation where many stakeholders and needs can be addressed with improved efficiency. Overall, communities and utilities should use the results to guide the increasing options available for powering the grid with DER, renewables, and carbon considerate energy.

14 SOLAR ENERGY↗

Airborne Advanced Reconfigurable Computer System (ARCS)

A digital computer subsystem fault-tolerant concept was defined, and the potential benefits and costs of such a subsystem were assessed when used as the central element of a new transport's flight control system. The derived advanced reconfigurable computer system (ARCS) is a triple-redundant computer subsystem that automatically reconfigures, under multiple fault conditions, from triplex to duplex to simplex operation, with redundancy recovery if the fault condition is transient. The study included criteria development covering factors at the aircraft's operation level that would influence the design of a fault-tolerant system for commercial airline use. A new reliability analysis tool was developed for evaluating redundant, fault-tolerant system availability and survivability; and a stringent digital system software design methodology was used to achieve design/implementation visibility.

Bjurman, B. E.↗

Support systems design and analysis

The integration of Kennedy Space Center (KSC) ground support systems with the new launch processing system and new launch vehicle provided KSC with a unique challenge in system design and analysis for the Space Transportation System. Approximately 70 support systems are controlled and monitored by the launch processing system. Typical systems are main propulsion oxygen and hydrogen loading systems, environmental control life support system, hydraulics, etc. An End-to-End concept of documentation and analysis was chosen and applied to these systems. Unique problems were resolved in the areas of software analysis, safing under emergency conditions, sampling rates, and control loop analysis. New methods of performing End-to-End reliability analyses were implemented. The systems design approach selected and the resolution of major problem areas are discussed.

Ferguson, R. M.↗

Batching System for Superior Service

Veridian's Portable Batch System (PBS) was the recipient of the 1997 NASA Space Act Award for outstanding software. A batch system is a set of processes for managing queues and jobs. Without a batch system, it is difficult to manage the workload of a computer system. By bundling the enterprise's computing resources, the PBS technology offers users a single coherent interface, resulting in efficient management of the batch services. Users choose which information to package into "containers" for system-wide use. PBS also provides detailed system usage data, a procedure not easily executed without this software. PBS operates on networked, multi-platform UNIX environments. Veridian's new version, PBS Pro,TM has additional features and enhancements, including support for additional operating systems. Veridian distributes the original version of PBS as Open Source software via the PBS website. Customers can register and download the software at no cost. PBS Pro is also available via the web and offers additional features such as increased stability, reliability, and fault tolerance.A company using PBS can expect a significant increase in the effective management of its computing resources. Tangible benefits include increased utilization of costly resources and enhanced understanding of computational requirements and user needs.

Source record↗

Equipment Analysis

Magnavox Government & Electronics Company originally used the NASTRAN program in the design stage of heavy aluminum fixtures for vibration testing. Program also used to compare the resonant frequencies of the circuitry to predict whether failures may occur because of high vibration levels. The company engineers can then make design alterations to improve the equipment's vibration resistance. Method allows Magnavox to insure reliability and reduce any possibility of vibration-caused failure in critical defense products they manufacture. Magnavox uses another COSMIC software package called GENOPTICS in the development of a Digital Optical Recorder, and also in research and development of other optical systems. This enables use of an optically recorded disc to store and retrieve digital data. It is reported that this program provides accurate results and that its use saved six man-months of time that would have been needed to develop a comparable software package.

Source record↗

High End Computing Technologies for Earth Science Applications: Trends, Challenges, and Innovations

Earth science applications of the future will stress the capabilities of even the highest performance supercomputers in the areas of raw compute power, mass storage management, and software environments. These NASA mission critical problems demand usable multi-petaflops and exabyte-scale systems to fully realize their science goals. With an exciting vision of the technologies needed, NASA has established a comprehensive program of advanced research in computer architecture, software tools, and device technology to ensure that, in partnership with US industry, it can meet these demanding requirements with reliable, cost effective, and usable ultra-scale systems. NASA will exploit, explore, and influence emerging high end computing architectures and technologies to accelerate the next generation of engineering, operations, and discovery processes for NASA Enterprises. This article captures this vision and describes the concepts, accomplishments, and the potential payoff of the key thrusts that will help meet the computational challenges in Earth science applications.

Parks, John↗

VIPER Lunar Rover Agile Mission Systems

The VIPER Lunar Rover, scheduled for a November, 2024 launch, is a solar powered rover that will search for volatiles at the lunar south pole. VIPER is an operationally complex mission operating in a challenging lighting and communications environment, requiring new design in a number of areas, from mission planning, to real-time waypoint driving. The combination of solar power, limited battery and the dynamic movement of shadows at the south pole gives VIPER small operational margins. The Mission System will be used to operate VIPER during cruise and on the lunar surface. To maximize efficiency and flexibility in Mission System design and thus to improve the performance and reliability of the resulting Mission System, we are tailoring Agile principles that we have used effectively in ground data system software development and applying those principles to the design of elements of the mission system.

Agile↗

Event Tree Success Branch Modeling Approaches in SAPHIRE/SPAR

Standardized Plant Analysis Risk (SPAR) models are a set of linked fault tree/event tree PRA models that have been used by the Nuclear Regulatory Commission (NRC) to evaluate the risk of operations at U.S. nuclear power plants since 1990s. The models use the Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) code developed by the NRC and Idaho National Laboratory (INL). Currently Version 8, SAPHIRE is a powerful software with advanced features to perform separated or integrated Level 1, Level 2, internal events, external events, at-power, and low power shutdown PRA [1]. One of its features is the availability of three different approaches to model the success branch of a top event in event tree: delete term, complement of system logic, and developed event. However, improper choosing and modeling success branch might yield unexpected and incorrect results. This paper will discuss the two most often used success branch modeling approaches, delete term and developed event, and provide recommendations for using proper approaches in different models. A potential SAPHIRE code enhancement is also proposed to address the adverse impact brought by the developed event approach.

99 GENERAL AND MISCELLANEOUS↗

Practical and reliable error bars for quantum process tomography

Current techniques in quantum process tomography typically return a single point estimate of an unknown process based on a finite albeit large amount of measurement data. Due to statistical fluctuations, however, other processes close to the point estimate can also produce the observed data with near certainty. Unless appropriate error bars can be constructed, the point estimate does not carry any sound operational interpretation. Here, we provide a solution to this problem by constructing a confidence region estimator for quantum processes. Our method enables reliable estimation of essentially any figure of merit for quantum processes on few qubits, including the diamond distance to a specific noise model, the entanglement fidelity, and the worst-case entanglement fidelity, by identifying error regions which contain the true state with high probability. We also provide a software package, QPtomographer, implementing our estimator for the diamond norm and the worst-case entanglement fidelity. We illustrate its usage and performance with several simulated examples. Furthermore, our tools can be used to reliably certify the performance of, e.g., error correction codes, implementations of unitary gates, or more generally any noise process affecting a quantum system.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The methodology of multi-viewpoint clustering analysis

One of the greatest challenges facing the software engineering community is the ability to produce large and complex computer systems, such as ground support systems for unmanned scientific missions, that are reliable and cost effective. In order to build and maintain these systems, it is important that the knowledge in the system be suitably abstracted, structured, and otherwise clustered in a manner which facilitates its understanding, manipulation, testing, and utilization. Development of complex mission-critical systems will require the ability to abstract overall concepts in the system at various levels of detail and to consider the system from different points of view. Multi-ViewPoint - Clustering Analysis MVP-CA methodology has been developed to provide multiple views of large, complicated systems. MVP-CA provides an ability to discover significant structures by providing an automated mechanism to structure both hierarchically (from detail to abstract) and orthogonally (from different perspectives). We propose to integrate MVP/CA into an overall software engineering life cycle to support the development and evolution of complex mission critical systems.

Mehrotra, Mala↗

Automatic Fault Protection in the Voyager Spacecraft

Due to reliability requirements placed on the Voyager spacecraft system design and a mission resulting in long two-way, light time communication links, on-board automatic fault detection and correction capabilities are a significant feature of that spacecraft's design. Most of the protection to otherwise mission-catastrophic failures is implemented in the software of the voyager's central computer, while some resides in an attitude control-dedicated processor. This paper will present the role that automatic fault protection plans in achieving Voyager's overall reliability, its design evolution, and how its design was validated during system testing. In-flight experience will also be described, and from the lessons learned there-in, conclusions and recommendations will be drawn for the benefit of future designs.

Jones, C. P.↗

Enabling a Voice Management System for Space Applications, Design and Software Development

Sustainable missions, beyond low Earth orbit, will require autonomous capabilities in order to achieve NASA’s Artemis program objectives. Correspondingly, the crew must have a means to efficiently interact with these autonomous systems; this can be facilitated via voice and speech communications. Voice-based controls enable the user to access autonomous systems hands-free/eyes-free, allowing the user to better focus on critical tasks. The goal of this project was to explore the knowledge and technology needed to successfully design effective voice interfaces for autonomous systems. The main objective was to understand how a crew member, through voice interaction, could most efficiently and intuitively communicate with a notional autonomous vehicle system manager. This project leveraged prior research conducted by the University of Michigan’s Bioastronautics and Life Support System (BLiSS) team as part of a NASA Moon to Mars eXploration Systems and Habitation (M2M X-Hab) 2020 Academic Innovation Challenge. The X-Hab 2020 work from the BliSS Team resulted in an intuitive graphical user interface/user experience that was built on an Internet of Things (IOT) platform. The Voice User Interface (VUI) design for the M2M X-Hab 2021 project leveraged this technology and incorporated a voice-based assistant and NASA’s Platform for Autonomous Systems (NPAS) software. This required technologies to convert voice to text, conduct semantic interpretations, and convert responses from the autonomous system to text and to speech; additionally, the background noise environment of spacecraft was assessed, and a relatable personality for the autonomous system to facilitate human-like conversations was created. This work’s success was largely due to the diverse team that included expertise in Space Systems Engineering, Human Computer Interaction, Aerospace Engineering, Computer Science, Biomedical Engineering, and Applied Physics. The differing perspectives fostered elaborate discussions, resulting in the conception of three main interactions: (1) User-System, (2) NPAS-System, and (3) Environment-System. The system developed, i.e. the VUI, had to be unique, efficient, and intuitive; thus, the team crafted a personality for the system to enable human-like conversation. User surveys sent to students and young professionals were used to help determine these personality traits by capturing perspectives and expectations of the “Artemis Generation Astronauts”. To further simulate human-like conversations, the system had to be able to quickly interpret user speech and be able to integrate with NASA’s NPAS system for quick and reliable information transfer. Results of this research include (1) a working prototype user interface, that is compatible with NASA’s NPAS system; (2) software that demonstrates the ability to interpret user requests and respond appropriately; (3) the capability to implement fully expanded conversations between user and system using intuitive communication in four request categories; and (4) software and hardware recommendations that optimize the system’s ability to operate, i.e. be heard, in a noisy environment. The technologies chosen for this project’s demonstrations included the following: Raspberry Pi, RASA, Mozilla Deep Speech, Coqui, RTX Voice and Adobe XD. This work has laid the foundation for the development of VUI’s used for autonomy, and is intended to provide guidance for future VUI development.

Tara Vega↗

Quality Attributes for Mission Flight Software: A Reference for Architects

In the international standards for architecture descriptions in systems and software engineering (ISO/IEC/IEEE 42010), "concern" is a primary concept that often manifests itself in relation to the quality attributes or "ilities" that a system is expected to exhibit - qualities such as reliability, security and modifiability. One of the main uses of an architecture description is to serve as a basis for analyzing how well the architecture achieves its quality attributes, and that requires architects to be as precise as possible about what they mean in claiming, for example, that an architecture supports "modifiability." This paper describes a table, generated by NASA's Software Architecture Review Board, which lists fourteen key quality attributes, identifies different important aspects of each quality attribute and considers each aspect in terms of requirements, rationale, evidence, and tactics to achieve the aspect. This quality attribute table is intended to serve as a guide to software architects, software developers, and software architecture reviewers in the domain of mission-critical real-time embedded systems, such as space mission flight software.

Software architecture↗

HYPPO: A Surrogate-Based Multi-Level Parallelism Tool for Hyperparameter Optimization

We present a new software, HYPPO, that enables the automatic tuning of hyperparameters of various deep learning (DL) models. Unlike other hyperparameter optimization (HPO) methods, HYPPO uses adaptive surrogate models and directly accounts for uncertainty in model predictions to find accurate and reliable models that make robust predictions. Using asynchronous nested parallelism, we are able to significantly alleviate the computational burden of training complex architectures and quantifying the uncertainty. HYPPO is implemented in Python and can be used with both TensorFlow and PyTorch libraries. We demonstrate various software features on time-series prediction and image classification problems as well as a scientific application in computed tomography image reconstruction. Finally, we show that (1) we can reduce by an order of magnitude the number of evaluations necessary to find the most optimal region in the hyperparameter space and (2) we can reduce by two orders of magnitude the throughput for such HPO process to complete.

adaptation models↗

The Design of a Fault-Tolerant COTS-Based Bus Architecture

In this paper, we report our experiences and findings on the design of a fault-tolerant bus architecture comprised of two COTS buses, the IEEE 1394 and the 12C. This fault-tolerant bus is the backbone system bus for the avionics architecture of the X2000 program at the Jet Propulsion Laboratory. COTS buses are attractive because of the availability of low cost commercial products. However, they are not specifically designed for highly reliable applications such as long-life deep-space missions. The X2000 design team has devised a multi-level fault tolerance approach to compensate for this shortcoming of COTS buses. First, the approach enhances the fault tolerance capabilities of the IEEE 1394 and 12 C buses by adding a layer of fault handling hardware and software. Second, algorithms are developed to enable the IEEE 1394 and the 12 C buses assist each other to isolate and recovery from faults. Third, the set of IEEE 1394 and 12 C buses is duplicated to further enhance system reliability. The X2000 design team has paid special attention to guarantee that all fault tolerance provisions will not cause the bus design to deviate from the commercial standard specifications. Otherwise, the economic attractiveness of using COTS will be diminished. The hardware and software design of the X2000 fault-tolerant bus are being implemented and flight hardware will be delivered to the ST4 and Europa Orbiter missions.

Chau, Savio N.↗