Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Audit”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

RSRM Nozzle Anomalous Throat Erosion Investigation Overview

In September, 1996, anomalous pocketing erosion was observed in the aft end of the throat ring of the nozzle of one of the reusable solid rocket motors (RSRM 56B) used on NASA's space transportation system (STS) mission 79. The RSRM throat ring is constructed of bias tape-wrapped carbon cloth/ phenolic (CCP) ablative material. A comprehensive investigation revealed necessary and sufficient conditions for occurrence of the pocketing event and provided rationale that the solid rocket motors for the subsequent mission, STS-80, were safe to fly. The nozzles of both of these motors also exhibited anomalous erosion similar to, but less extensive than that observed on STS-79. Subsequent to this flight, the investigation to identify both the specific causes and the corrective actions for elimination of the necessary and sufficient conditions for the pocketing erosion was intensified. A detailed fault tree approach was utilized to examine potential material and process contributors to the anomalous performance. The investigation involved extensive constituent and component material property testing, pedigree assessments, supplier audits, process audits, full scale processing test article fabrication and evaluation, thermal and thermostructural analyses, nondestructive evaluation, and material performance tests conducted using hot fire simulation in laboratory test beds and subscale and full scale solid rocket motor static test firings. This presentation will provide an over-view of the observed anomalous nozzle erosion and the comprehensive, fault-tree based investigation conducted to resolve this issue.

Clinton, R. G., Jr.↗

CM and DM in an ISO R and D Environment

ISO 9000 - a common buzz word in industry is making inroads to government agencies. The National Aeronautics and Space Agency (NASA) achieved ISO 9001 certification at each of its nine (9) Centers and Headquarters in 1998-1999. NASA Glenn Research Center (GRC) was recommended for certification in September 1999. Since then, each of the Centers has been going through the semi-annual surveillance audits. Growing out of the manufacturing industry, successful application of the international quality standard to a research and development (R&D) environment has had its challenges. This paper will address how GRC applied Configuration Management (CM) and Data (or Document) Management (DM) to meet challenges to achieve ISO certification. One of the first challenges was to fit the ISO 9001-1994 elements to the GRC environment. Some of the elements fit well-Management Responsibility (4.1), Internal Audits (4.17), Document and Data Control (4.5). Other elements were not suited or applied easily to the R&D environment-Servicing (4.19), Statistical Techniques (4.20). Since GRC "builds" only one or two items at a time, these elements were considered not applicable to the environment.

Crowley, Sandra L.↗

Extraction and Analysis of Display Data

The Display Audit Suite is an integrated package of software tools that partly automates the detection of Portable Computer System (PCS) Display errors. [PCS is a lap top computer used onboard the International Space Station (ISS).] The need for automation stems from the large quantity of PCS displays (6,000+, with 1,000,000+ lines of command and telemetry data). The Display Audit Suite includes data-extraction tools, automatic error detection tools, and database tools for generating analysis spread sheets. These spread sheets allow engineers to more easily identify many different kinds of possible errors. The Suite supports over 40 independent analyses, 16 NASA Tech Briefs, November 2008 and complements formal testing by being comprehensive (all displays can be checked) and by revealing errors that are difficult to detect via test. In addition, the Suite can be run early in the development cycle to find and correct errors in advance of testing.

Land, Chris↗

Actions Needed to Ensure Scientific and Technical Information is Adequately Reviewed at Goddard Space Flight Center, Johnson Space Center, Langley Research Center, and Marshall Space Flight Center

This audit was initiated in response to a hotline complaint regarding the review, approval, and release of scientific and technical information (STI) at Johnson Space Center. The complainant alleged that Johnson personnel conducting export control reviews of STI were not fully qualified to conduct those reviews and that the reviews often did not occur until after the STI had been publicly released. NASA guidance requires that STI, defined as the results of basic and applied scientific, technical, and related engineering research and development, undergo certain reviews prior to being released outside of NASA or to audiences that include foreign nationals. The process includes technical, national security, export control, copyright, and trade secret (e.g., proprietary data) reviews. The review process was designed to preclude the inappropriate dissemination of sensitive information while ensuring that NASA complies with a requirement of the National Aeronautics and Space Act of 1958 (the Space Act)1 to provide for the widest practicable and appropriate dissemination of information resulting from NASA research activities. We focused our audit on evaluating the STI review process: specifically, determining whether the roles and responsibilities for the review, approval, and release of STI were adequately defined and documented in NASA and Center-level guidance and whether that guidance was effectively implemented at Goddard Space Flight Center, Johnson Space Center, Langley Research Center, and Marshall Space Flight Center. Johnson was included in the review because it was the source of the initial complaint, and Goddard, Langley, and Marshall were included because those Centers consistently produce significant amounts of STI.

Information management↗

Electrostatic Evaluation of the SRB Velostat(Trademark) Pads

During RSRM Grain inspection, pads constructed of Velostat are grounded and installed in the RSRM bore enabling inspectors to move throughout the bore during the inspection. Velostat pads are installed by grounding the first pad installed and subsequent pads are installed overlapping the previously installed pad maintaining a conductive path to facility ground. Pads are removed upon completion of the inspection in a reverse fashion. As the pads are removed scanning of propellant surfaces is performed per OMRS. During PPICI Audit of B5308.006 (Forward Segment Grain Inspection) in October 07 one audit finding noted that electrostatic scanning of propellant surfaces was being performed during removal of conductive pads following grain inspection. ATK does not perform electrostatic scanning of propellant surfaces during pad removal following final inspection at the plant. The integrated team consisting of NASA SE, USA SE, USA QE, ATK LSS, ATK Systems Safety and ATK DE concurred that electrostatic scanning of propellant surfaces was unnecessary as the conductive pads are grounded. Additional time spent in bore performing scanning presents itself as additional risk. Technicians reported that they have never seen any voltage readings while scanning propellant surfaces during pad removal. USA Systems engineering has written KB 17530 in response to the finding which will delete the requirement (item 2 B47GEN.ll0) to scan propellant surfaces during pad removal. As a result of an E3 panel discussion on December 13, 2007, it was decided that verification of the electrical grounding of the Velostat pads be verified.

Buhler, Charles R.↗

GSFC Supplier Surveillance

Topics covered include: Develop Program/Project Quality Assurance Surveillance Plans The work activities performed by the developer and/or his suppliers are subject to evaluation and audit by government-designated representatives. CSO supports project by selecting on-site supplier representative s by one of several methods: (1) a Defense Contract Management Agency (DCMA) person via a Letter Of Delegation (LOD), (2) an independent assurance contractor (IAC) via a contract Audits, Assessments, and Assurance (A3) Contract Code 300 Mission Assurance Support Contract (MASC)

Kelly, Michael P.↗

Rapid Diagnostics of Onboard Sequences

Keeping track of sequences onboard a spacecraft is challenging. When reviewing Event Verification Records (EVRs) of sequence executions on the Mars Exploration Rover (MER), operators often found themselves wondering which version of a named sequence the EVR corresponded to. The lack of this information drastically impacts the operators diagnostic capabilities as well as their situational awareness with respect to the commands the spacecraft has executed, since the EVRs do not provide argument values or explanatory comments. Having this information immediately available can be instrumental in diagnosing critical events and can significantly enhance the overall safety of the spacecraft. This software provides auditing capability that can eliminate that uncertainty while diagnosing critical conditions. Furthermore, the Restful interface provides a simple way for sequencing tools to automatically retrieve binary compiled sequence SCMFs (Space Command Message Files) on demand. It also enables developers to change the underlying database, while maintaining the same interface to the existing applications. The logging capabilities are also beneficial to operators when they are trying to recall how they solved a similar problem many days ago: this software enables automatic recovery of SCMF and RML (Robot Markup Language) sequence files directly from the command EVRs, eliminating the need for people to find and validate the corresponding sequences. To address the lack of auditing capability for sequences onboard a spacecraft during earlier missions, extensive logging support was added on the Mars Science Laboratory (MSL) sequencing server. This server is responsible for generating all MSL binary SCMFs from RML input sequences. The sequencing server logs every SCMF it generates into a MySQL database, as well as the high-level RML file and dictionary name inputs used to create the SCMF. The SCMF is then indexed by a hash value that is automatically included in all command EVRs by the onboard flight software. Second, both the binary SCMF result and the RML input file can be retrieved simply by specifying the hash to a Restful web interface. This interface enables command line tools as well as large sophisticated programs to download the SCMF and RMLs on-demand from the database, enabling a vast array of tools to be built on top of it. One such command line tool can retrieve and display RML files, or annotate a list of EVRs by interleaving them with the original sequence commands. This software has been integrated with the MSL sequencing pipeline where it will serve sequences useful in diagnostics, debugging, and situational awareness throughout the mission.

Starbird, Thomas W.↗

NASA Electronic Parts and Packaging (NEPP) Program

Recent Findings from Audits, New Technology Data Reviews a) Disabled Chip Burn-ins A recent audit for a QML device discovered that the chip was disabled during the static burn-in, thus it was not drawing any current. Recommendation: For new SMDs add a statement within the burn-in paragraphs stating that the parts shall be kept in their enabled state during the burn-in. b) Class Q 160-hr/125oC Burn-in This is being interpreted as a static burn-in (even for CMOS technology). Recommendation: Provide clarification in MIL-STD-883, Test Method 5004. c) At Frequency (Dynamic) Burn-ins Test equipment limitation is being cited for not doing burn-ins at the application frequency. Recommendation: The burn-in task group to discuss and provide guidance. When the SMD says that the part can be used at 200 MHz, then doing burn-in at 6 MHz (cited as burn-in equipment limitation frequency) is not going to be meaningful! d) Two Static Burn-ins Some manufacturers are doing electrical testing between the two static burn-ins, whereas others do electricals after completing both static burn-ins. Recommendation: Provide clarification in MIL-STD-883, Test Method 5004. e) Thermal Imaging For a device with hot spots, the thermal resistance, junction-to-case, would be much higher than the guidelines given in MIL-STD-1835. One of the suppliers used thermal imaging to find hot spots on the die. Recommendation: Assign a task group to evaluate the effectiveness of thermal imaging at the product development stage.

Class Y↗

Business Management System Support Analysis

The purpose of this research project was to develop a searchable database compiled with internal and external audit findings/observations. The data will correspond to the findings and observations from the date of Center-wide implementation of the ISO 9001-2000 standard to the present (2003-2008). It was derived and extracted from several sources and was in multiple formats. Once extracted, categorization of the findings/observations would be possible. The final data was mapped to the ISO 9001-2000 standard with the understanding that it will be displayed graphically. The data will be used to verify trends, associate risks, and establish timelines to identify strengths and weaknesses to determine areas of improvement in the Kennedy Space Center Business Management System Internal Audit Program.

Parikh, Jay↗

MAVEN Information Security Governance, Risk Management, and Compliance (GRC): Lessons Learned

As the first interplanetary mission managed by the NASA Goddard Space Flight Center, the Mars Atmosphere and Volatile EvolutioN (MAVEN) had three IT security goals for its ground system: COMPLIANCE, (IT) RISK REDUCTION, and COST REDUCTION. In a multiorganizational environment in which government, industry and academia work together in support of the ground system and mission operations, information security governance, risk management, and compliance (GRC) becomes a challenge as each component of the ground system has and follows its own set of IT security requirements. These requirements are not necessarily the same or even similar to each other's, making the auditing of the ground system security a challenging feat. A combination of standards-based information security management based on the National Institute of Standards and Technology (NIST) Risk Management Framework (RMF), due diligence by the Mission's leadership, and effective collaboration among all elements of the ground system enabled MAVEN to successfully meet NASA's requirements for IT security, and therefore meet Federal Information Security Management Act (FISMA) mandate on the Agency. Throughout the implementation of GRC on MAVEN during the early stages of the mission development, the Project faced many challenges some of which have been identified in this paper. The purpose of this paper is to document these challenges, and provide a brief analysis of the lessons MAVEN learned. The historical information documented herein, derived from an internal pre-launch lessons learned analysis, can be used by current and future missions and organizations implementing and auditing GRC.

FISMA↗

Tailoring NIST Security Controls for the Ground System: Selection and Implementation -- Recommendations for Information System Owners

The National Aeronautics and Space Administration (NASA) invests millions of dollars in spacecraft and ground system development, and in mission operations in the pursuit of scientific knowledge of the universe. In recent years, NASA sent a probe to Mars to study the Red Planet's upper atmosphere, obtained high resolution images of Pluto, and it is currently preparing to find new exoplanets, rendezvous with an asteroid, and bring a sample of the asteroid back to Earth for analysis. The success of these missions is enabled by mission assurance. In turn, mission assurance is backed by information assurance. The information systems supporting NASA missions must be reliable as well as secure. NASA - like every other U.S. Federal Government agency - is required to manage the security of its information systems according to federal mandates, the most prominent being the Federal Information Security Management Act (FISMA) of 2002 and the legislative updates that followed it. Like the management of enterprise information technology (IT), federal information security management takes a "one-size fits all" approach for protecting IT systems. While this approach works for most organizations, it does not effectively translate into security of highly specialized systems such as those supporting NASA missions. These systems include command and control (C&C) systems, spacecraft and instrument simulators, and other elements comprising the ground segment. They must be carefully configured, monitored and maintained, sometimes for several years past the missions' initially planned life expectancy, to ensure the ground system is protected and remains operational without any compromise of its confidentiality, integrity and availability. Enterprise policies, processes, procedures and products, if not effectively tailored to meet mission requirements, may not offer the needed security for protecting the information system, and they may even become disruptive to mission operations. Certain protective measures for the general enterprise may not be as efficient within the ground segment. This is what the authors have concluded through observations and analysis of patterns identified from the various security assessments performed on NASA missions such as MAVEN, OSIRIS-REx, New Horizons and TESS, to name a few. The security audits confirmed that the framework for managing information system security developed by the National Institute of Standards and Technology (NIST) for the federal government, and adopted by NASA, is indeed effective. However, the selection of the technical, operational and management security controls offered by the NIST model - and how they are implemented - does not always fit the nature and the environment where the ground system operates in even though there is no apparent impact on mission success. The authors observed that unfit controls, that is, controls that are not necessarily applicable or sufficiently effective in protecting the mission systems, are often selected to facilitate compliance with security requirements and organizational expectations even if the selected controls offer minimum or non-existent protection. This paper identifies some of the standard security controls that can in fact protect the ground system, and which of them offer little or no benefit at all. It offers multiple scenarios from real security audits in which the controls are not effective without, of course, disclosing any sensitive information about the missions assessed. In addition to selection and implementation of controls, the paper also discusses potential impact of recent legislation such as the Federal Information Security Modernization Act (FISMA) of 2014 - aimed at the enterprise - on the ground system, and offers other recommendations to Information System Owners (ISOs).

GOVERNANCE↗

Modern Scientific Data Governance Framework

Science has entered the era of Big Data with new challenges related to data governance, stewardship, and management. The existing data governance practices must catch up to ensure proper data management. Existing data governance policies and stewardship best practices tend to be disconnected from operational data management practices and enforcement and mainly exist in well-meaning documents or reports. These governance policies are, at best, partially implemented and rarely monitored or audited. In addition, existing governance policies keep adding additional data management steps that require a human, ‘a data steward’, in the loop, and the cost of data management can no longer scale proportionately with the current and future increased data volume and complexity. The goal for developing an updated data governance framework is to modernize scientific data governance to the reality of Big data and align it with the current technology trends such as cloud computing and AI. The goals of this framework are two folds. One is to ensure thoroughness that the governance adequately covers the entire data life cycle. Two, provide a practical approach that offers a consistent and repeatable process for different projects. Three core principles ground this framework. First, focus on just enough governance and prevent data governance from becoming a roadblock toward the scientific process. Remove any unnecessary processes and steps. Second, automate data management steps where possible. Actively remove steps that require ‘human in the loop’ within the management process to be efficient and scale with increasing data. Third, all the processes should continually be optimized using quantified metrics to streamline the monitoring and auditing workflows.

Rahul Ramachandran↗

Promoting Strong ISO 50001 Outcomes with Supportive National Infrastructure

The ISO 50001 standard is a key mechanism for reducing greenhouse gas emissions and improving energy efficiency globally. An increasing number of companies are seeking certification, creating the need for personnel that are competent to conduct ISO 50001 certification audits. The growth of ISO 50001 is expected to accelerate as more companies integrate ISO 50001 into their corporate sustainability strategies and supplier requirements. Robust implementation of ISO 50001 represents an important tool for countries with climate change mitigation goals. Because of its dual focus on continual improvement of an organization’s energy management system (EnMS) and its energy performance improvement, ISO 50001 requires skills of both implementers and certification auditors that are not well-supported by current credentials and training. This paper describes an effort to address skill gaps of certification auditors, a critical factor to ensure that ISO 50001 implementations are robust and result in continued energy performance improvement. A collaboration of governments through the Energy Management Working Group (EMWG), formerly under Global Superior Energy Performance (GSEP), has formed to build workforce capacity for ISO 50001 certification audits. The EMWG is leading the development of an internationally-relevant certification scheme for ISO 50001 Lead Auditor that meets requirements for ISO/IEC 17024 accreditation and ISO 50003 for defining ISO 50001 Lead Auditor competency. Wider availability of competent ISO 50001 Lead Auditors will ultimately increase the impact and market value of ISO 50001 certification and improve consistency of ISO 50001 certification outcomes by establishing a standardized and high level of knowledge and skills globally.

Siciliano, Graziella↗

Building America Case Study: Zero Energy Ready Home and the Challenge of Hot Water on Demand, Denver, Colorado

"This report outlines the steps a developer can use when looking to create and implement higher performance standards such as the U.S. Department of Energy (DOE) Zero Energy Ready Home (ZERH) standards in a community. The report also describes the specific examples of how this process was followed by a developer, Forest City, in the Stapleton community in Denver, Colorado. IBACOS described the steps used to begin to bring the DOE ZERH standard to the Forest City Stapleton community based on 15 years of community-scale development work done by IBACOS. As a result of this prior IBACOS work, the team gained an understanding of the various components that a master developer needs to consider and created strategies for incorporating those components in the initial phases of development to achieve higher performance buildings in the community. An automated scoring system can be used to perform an internal audit that provides a detailed and consistent evaluation of how several homes under construction or builders' floor plans compare with the requirements of the DOE Zero Energy Ready Home program. This audit can be performed multiple times at specific milestones during construction to allow the builder to make changes as needed throughout construction for the project to meet Zero Energy Ready Home standards. This scoring system also can be used to analyze a builder's current construction practices and design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Method to Test Model Calibration Techniques: Preprint

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Method to Test Model Calibration Techniques

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Blockchain: Next Generation Supply Chain Security for Energy Infrastructure and NERC Critical Infrastructure Protection (CIP) Compliance

The U.S. power grid is a complex system of systems that requires a secure, reliable and trustworthy global supply chain. This is especially true for the grid’s increasing number of networked energy delivery system (EDS) and industrial control systems (ICS) and associated vendors, distributers, integrators and end users. Grid modernization has increased the use of “smart” energy devices that network, digitize, automate and increasingly converge the cyber-physical energy supply chain. In this Energy Internet of Things (EIoT) environment there is an increasing number of both critical cyber assets as well as data speed and size requirements, creating new cyber supply chain security and North American Electric Reliability Corporation (NERC) CIP compliance challenges for utilities, regulators and vendors. In realization of these goals, improvements are needed in the process and technology to better monitor, audit and realize cyber security and compliance goals in complex EIoT environments. This paper explores how blockchain technology may present a disruptive solution to facilitate NERC CIP compliance and increase the security of the electricity infrastructure supply chain through a cryptographically signed distributed ledger that provides increased data provenance, attribution and auditability.

Blockchain, Cyber security, grid cyber, NERC CIP, ↗

In-situ Detection of Glovebox Glove Degradation Prior to Glove Failure; Effects on Safety, Waste, and Operational Costs - 20402

Glovebox glove pressure decay leak testing and analysis of the data can greatly improve glovebox safety, minimize Transuranic (TRU) glove waste, and minimize operational cost. It is well known, the weakest point of containment on a glovebox is the glove. Mitigating unplanned openings in gloves is critical to minimizing operational and safety costs in glovebox operations. Mitigating unplanned glove openings due to glove failures will be discussed in this paper. The lack of an engineered solution to determine a gloves operational life in nuclear operations, has lead to use of theoretical and manual subjective methods to determine the life and safety of a glovebox glove. Whether the glove is inspected visually prior to use, or gloves are changed regularly to theoretically avoid failure, both the operators PPE and the room are being exposed to contamination, or un-necessary amounts of TRU glove waste are being generated. Millions of dollars yearly in operational costs are spent on glove failures due to loss of production, incident analysis, regulatory audits, clean up, and paperwork. In a nuclear application, a glove failure could contaminate an operator and laboratory, shut down the operation for weeks, potentially create a regulatory audit, and potentially create a media frenzy; the damages to the organization can be astronomical. Elimination of glove failures is possible by tracking glove material degradation and setting limits to allow glove change when it becomes necessary, prior to glove failure. Analytical pressure decay leak testing allows the detection of material degradation, and in turn the ability to limit operational glove failures. A German based company called MK Versuchsanlagen, e.K., has developed an advanced Glove Integrity Testing System. The system, with its use of proprietary RFID and special software technology, is unique in its capabilities. The system is capable to perform highly accurate regular glove testing on any size glovebox line in minimal time. The system records and can analyze a tremendous amount of system data that in turn can determine, for example, a safe glove change time prior to a glove material failure. This paper will show how an advanced Glove Integrity Testing System can detect glove material degradation and help determine a safe change point prior to glove failure. Pressure decay curves of new gloves and recorded effects of accelerated aging on the glove over time will be shown. The use of this technology in nuclear facilities can greatly improve glovebox operational safety, minimize glovebox glove TRU waste, and save organizations tremendous costs in downtime, clean up, documentation, and potential regulatory review. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗