Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,081 records · Page 60

Mechanics of Preloaded Bolt Tensile Loading With Focus on Load Introduction Factor

The bolt tensile and joint separation loads are directly influenced by the locations at which the external loads enter the clamped members of a preloaded bolted joint (PBJ) and the associated load-paths through the joint. This physical load introduction mechanism affecting the bolt tensile loading is typically represented in the bolt tensile load equation, in part, by a load introduction factor (LIF), which was shown by H.M. Lee of Marshall Spaceflight Center to be a natural product of the bolt tensile load equation using a linear spring stiffness model. This LIF, being a function of load-path stiffness, has subsequently been denoted as the stiffness-based LIF (SBLIF), providing a framework to calculate the LIF using whatever load-path stiffness approximations are appropriate. Expanding upon the work of Lee, it is shown that the SBLIF and the joint stiffness factor are functions of the stiffnesses of the same load-paths and regions within a PBJ, and thus they should not be treated as independent variables. Mathematical expressions for the SBLIF are presented. Comparisons are shown between the analytically calculated SBLIF, the analytically calculated geometric LIF (GLIF), which is a simple clamped-member thickness ratio, the experimentally derived LIF, and the LIF determined by finite element analysis (FEA). Using experiment and FEA as a benchmark, the SBLIF, using traditional load-path stiffness approximations, enables a more accurate prediction of bolt tensile loading than the GLIF, although it can be unconservative near joint separation. The GLIF generally attributes more of the externally applied tensile load to the bolt than does the SBLIF, potentially resulting in heavier and/or more costly bolted joints. Mathematical relationships between the SBLIF and the GLIF are developed. Supplemental material is provided in the appendixes where the historical practice of using the joint compressive stiffness in place of the joint tensile stiffness is evaluated. The appendixes include step-by-step examples demonstrating the calculation of the SBLIF using traditional stiffness approximations and conclude with the development of the joint diagram in terms of the SBLIF, culminating into formulas for the key features of a joint diagram, which is useful for programming.

Load Path↗

Analysis of Impact Induced Damage and its Effect on Structural Integrity of Space Flight Composite Overwrapped Pressure Vessels

The objective of this research work has been to provide analytical background and support to the ongoing experimental program at NASA, White Sands Test Facility, involving testing composite overwrapped pressure vessels (COPV) for impact damage and cyclic pressurization. Preliminary theoretical basis, including the governing equations for a shallow shell subjected to internal pressure, has been established. Effects of the Griffith type cracks on the structural integrity of the cylindrical vessel were evaluated by methods of Fracture Mechanics. The results indicate that the effective mass of the pressure vessel is an important factor influencing the response to impact events. We also have found that the material properties of the target, contained in the constitutive equations of the composite attached to the Aluminum liner, dominate the impact event in the low velocity range, the material properties become less important, while the target mass distribution and the impactor mass become more significant as the velocity of the impactor increases. Therefore, at high-velocity impact it is not only the kinetic energy of the impactor but also its mass which has a significant effect on the dynamics of the event, and consequently on the induced damage. This work also suggests a methodology for an assessment of the rate of loading effects on the degradation of the material toughness associated with a high-velocity impact where the rate effects become significant. To model the rate dependence of the material response a viscoelastic-plastic constitutive equations were assumed, and on this basis predictions are made regarding the rate dependent material resistance curve. Other dynamic phenomena associated with the impact event have been treated in the framework of the Computational Mechanics using the courtesy of Prof. P. Guebelle and his graduate student at University of Illinois at Urbana-Champaign who have an access to a super-fast computer located on their campus. Finally, the guidelines for a follow-up research program are provided in the body of this report. They address three major areas: theoretical research, numerical studies, and further experimental work.

Wnuk, Michael P.↗

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗

Satellite Soil Moisture Data Assimilation Impacts on Modeling Weather Variables and Ozone in the Southeastern US – Part 2: Sensitivity to Dry-Deposition Parameterizations

Ozone (O3) dry deposition is a major O3 sink. As a follow-up study of Huang et al. (2021), we quantify the impact of satellite soil moisture (SM) on model representations of this process when different dry-deposition parameterizations are implemented, based on which the implications for interpreting O3 air pollution levels and assessing the O3 impacts on human and ecosystem health are provided. The SM data from NASA's Soil Moisture Active Passive mission are assimilated into the Noah-Multiparameterization (Noah-MP) land surface model within the NASA Land Information System framework, semicoupled with Weather Research and Forecasting model with online Chemistry (WRF-Chem) regional-scale simulations covering the southeastern US. Major changes in the modeling system used include enabling the dynamic vegetation option, adding the irrigation process, and updating the scheme for the surface exchange coefficient. Two dry-deposition schemes are implemented, i.e., the Wesely scheme and a “dynamic” scheme, in the latter of which dry-deposition parameterization is coupled with photosynthesis and vegetation dynamics. It is demonstrated that, when the dynamic scheme is applied, the simulated O3 dry-deposition velocities vd and their stomatal and cuticular portions, as well as the total O3 fluxes Ft, are larger overall; vd and Ft are 2–3 times more sensitive to the SM changes due to the data assimilation (DA). Further, through case studies at two forested sites with different soil types and hydrological regimes, we highlight that, applying the Community Land Model type of SM factor controlling stomatal resistance (i.e., β factor) scheme in replacement of the Noah-type β factor scheme reduced the v(d) sensitivity to SM changes by ∼75 % at one site, while it doubled this sensitivity at the other site. Referring to multiple evaluation datasets, which may be associated with variable extents of uncertainty, the model performance of vegetation, surface fluxes, weather, and surface O3 concentrations shows mixed responses to the DA, some of which display land cover dependency. Finally, using model-derived concentration- and flux-based policy-relevant O3 metrics as well as their matching exposure–response functions, the relative biomass/crop yield losses for several types of vegetation/crops are estimated to be within a wide range of 1 %–17 %. Their sensitivities to the model's dry-deposition scheme and the implementation of SM DA are discussed.

Min Huang↗

Cellular Statistical Models of Broken Cloud Fields. Part IV: Effects of Pixel Size on Idealized Satellite Observations

In the fourth part of our “Cellular Statistical Models of Broken Cloud Fields” series we use the binary Markov processes framework for quantitative investigation of the effects of low resolution of idealized satellite observations on the statistics of the retrieved cloud masks. We assume that the cloud fields are Markovian and are characterized by the “actual” cloud fraction (CF) and scale length. We use two different models of observations: a simple discrete-point sampling and a more realistic “pixel” protocol. The latter is characterized by a state attribution function (SAF) which has the meaning of the probability that the pixel with a certain CF is declared cloudy in the observed cloud mask. The stochasticity of the SAF means that the cloud/clear attribution is not ideal and can be affected by external or unknown factors. We show that the observed cloud masks can be accurately described as Markov chains of pixels and use the master-matrix formalism (introduced in Part III of the series) for analytical computation of their parameters: the “observed” CF and scale length. This procedure allows us to establish a quantitative relationship (which is pixel-size dependent) between the actual and the observed cloud-field statistics. The feasibility of restoring the former from the latter is considered. The adequacy of our analytical approach to idealized observations is evaluated using numerical simulations. Comparison of the observed parameters of the simulated datasets with their theoretical expectations showed an agreement within 0.005 for the CF, while for the scale length it is within 1% in the sampling case and within 4% in the pixel case.

Mikhail D. Alexandrov↗

What Is the OPP Approach to the Next Generation of Laboratory Requirements

Planetary Protection Quality Management System NASA’s Office of Planetary Protection uses a quality-based process evaluation approach to verify planetary protection bioburden compliance over a project’s life cycle. The verification strategy shifts from a comparative direct assay approach validating hardware bioburden at a “moment in time,” to one that implements a continual quality assurance demonstration of the analytical process via established data requirements, laboratory operational, and management parameters throughout the mission’s entire assembly process. Laboratory quality-based systems and management strategies are standardized and implemented across government and industry. A standardized laboratory quality system approach increases transparency throughout the project’s life cycle and aligns planetary protection analytical approaches with government and industry practices to support both NASA and commercial endeavors. Strategies include the implementation of a laboratory quality management structure that documents and routinely validates parameters critical to experimental design and data collection, provides data quality assessment parameters, and ultimately validates that the collected data is of sufficient quality and quantity to meet the specified technical goals. Planetary protection can draw on these practices to provide a systematic process-based quality approach to support planetary protection validation and compliance requirements. Quality approaches including data quality objectives, method performance, data acceptance criteria and the associated laboratory quality management system are presented to provide an overview and framework for a planetary protection laboratory quality management system.

Amy Baker↗

Unsteady Turbopump Flow Simulations

The objective of the current effort is two-fold: 1) to provide a computational framework for design and analysis of the entire fuel supply system of a liquid rocket engine; and 2) to provide high-fidelity unsteady turbopump flow analysis capability to support the design of pump sub-systems for advanced space transportation vehicle. Since the space launch systems in the near future are likely to involve liquid propulsion system, increasing the efficiency and reliability of the turbopump components is an important task. To date, computational tools for design/analysis of turbopump flow are based on relatively lower fidelity methods. Unsteady, three-dimensional viscous flow analysis tool involving stationary and rotational components for the entire turbopump assembly has not been available, at least, for real-world engineering applications. Present effort is an attempt to provide this capability so that developers of the vehicle will be able to extract such information as transient flow phenomena for start up, impact of non-uniform inflow, system vibration and impact on the structure. Those quantities are not readily available from simplified design tools. In this presentation, the progress being made toward complete turbo-pump simulation capability for a liquid rocket engine is reported. Space Shuttle Main Engine (SSME) turbo-pump is used as a test case for the performance evaluation of the hybrid MPI/Open-MP and MLP versions of the INS3D code. Relative motion of the grid system for rotor-stator interaction was obtained by employing overset grid techniques. Time-accuracy of the scheme has been evaluated by using simple test cases. Unsteady computations for SSME turbopump, which contains 106 zones with 34.5 Million grid points, are currently underway on Origin 2000 systems at NASA Ames Research Center. Results from these time-accurate simulations with moving boundary capability and the performance of the parallel versions of the code will be presented.

Centin, Kiris C.↗

A New Theory of Nucleate Pool Boiling in Arbitrary Gravity

Heat transfer rates specific to nucleate pool boiling under various conditions are determined by the dynamics of vapour bubbles that are originated and grow at nucleation sites of a superheated surface. A new dynamic theory of these bubbles has been recently developed on the basis of the thermodynamics of irreversible processes. In contrast to other existing models based on empirically postulated equations for bubble growth and motion, this theory does not contain unwarrantable assumptions, and both the equations are rigorously derived within the framework of a unified approach. The conclusions of the theory are drastically different from those of the conventional models. The bubbles are shown to detach themselves under combined action of buoyancy and a surface tension force that is proven to add to buoyancy in bubble detachment, but not the other way round as is commonly presumed. The theory ensures a sound understanding of a number of so far unexplained phenomena, such as effect caused by gravity level and surface tension on the bubble growth rate and dependence of the bubble characteristics at detachment on the liquid thermophysical parameters and relevant temperature differences. The theoretical predictions are shown to be in a satisfactory qualitative and quantitative agreement with observations. When being applied to heat transfer at nucleate pool boiling, this bubble dynamic theory offers an opportunity to considerably improve the main formulae that are generally used to correlate experimental findings and to design boiling heat removal in various industrial applications. Moreover, the theory makes possible to pose and study a great deal of new problems of essential impact in practice. Two such problems are considered in detail. One problem concerns the development of a principally novel physical model for the first crisis of boiling. This model allows for evaluating critical boiling heat fluxes under various conditions, and in particular at different gravity levels, with a good agreement with experimental evidence. The other problem bears upon equilibrium shapes of a detached bubble near a heated surface in exceedingly low gravity. In low gravity or in weightlessness, the bubble can remain in the close vicinity of the surface for a long time, and its shape is greatly affected by the Marangoni effect due to both temperature and possible surfactant concentration being nonuniform along the interface. The bubble performs at these conditions like a heat pipe, with evaporation at the bubble lower boundary and condensation at its upper boundary, and ultimately ensures a substantial increase in heat removal as compared with that in normal gravity. Some other problems relevant to nucleate pool and forced convection boiling heat transfer are also discussed.

Buyevich, Y. A.↗

Reduced Complexity Model Intercomparison Project Phase 2: Synthesizing Earth System Knowledge for Probabilistic Climate Projections

Over the last decades, climate science has evolved rapidly across multiple expert domains. Our best tools to capture state-of-the-art knowledge in an internally self-consistent modelling framework are the increasingly complex fully coupled Earth System Models (ESMs). However, computational limitations and the structural rigidity of ESMs mean that the full range of uncertainties across multiple domains are difficult to capture with ESMs alone. The tools of choice are instead more computationally efficient reduced complexity models (RCMs), which are structurally flexible and can span the response dynamics across a range of domain-specific models and ESM experiments. Here we present Phase 2 of the Reduced Complexity Model Intercomparison Project (RCMIP Phase 2), the first comprehensive intercomparison of RCMs that are probabilistically calibrated with key benchmark ranges from specialized research communities. Unsurprisingly, but crucially, we find that models which have been constrained to reflect the key benchmarks better reflect the key benchmarks. Under the low-emissions SSP1-1.9 scenario, across the RCMs, median peak warming projections range from 1.3 to 1.7°C (relative to 1850-1900, using an observationally-based historical warming estimate of 0.8°C between 1850-1900 and 1995-2014). Further developing methodologies to constrain these projection uncertainties seems paramount given the international community's goal to contain warming to below 1.5°C above pre-industrial in the long-term. Our findings suggest that users of RCMs should carefully evaluate their RCM, specifically its skill against key benchmarks and consider the need to include projections benchmarks either from ESM results or other assessments to reduce divergence in future projections.

Climate↗

The Functional Breakdown Structure (FBS) and Its Relationship to Life Cycle Cost

The Functional Breakdown Structure (FBS) is a structured, modular breakdown of every function that must be addressed to perform a generic mission. It is also usable for any subset of the mission. Unlike a Work Breakdown Structure (WBS), the FBS is a function-oriented tree, not a product-oriented tree. The FBS details not products, but operations or activities that should be performed. The FBS is not tied to any particular architectural implementation because it is a listing of the needed functions, not the elements, of the architecture. The FBS for Space Transportation Systems provides a universal hierarchy of required functions, which include ground and space operations as well as infrastructure - it provides total visibility of the entire mission. By approaching the systems engineering problem from the functional view, instead of the element or hardware view, the SPST has created an exhaustive list of potential requirements which the architecture designers can use to evaluate the completeness of their designs. This is a new approach that will provide full accountability of all functions required to perform the planned mission. It serves as a giant check list to be sure that no functions are omitted, especially in the early architectural design phase. A significant characteristic of a FBS is that if architecture options are compared using this approach, then any missing or redundant elements of each option will be ' identified. Consequently, valid Life Cycle Costs (LCC) comparisons can be made. For example, one architecture option might not need a particular function while another option does. One option may have individual elements to perform each of three functions while another option needs only one element to perform the three functions. Once an architecture has been selected, the FBS will serve as a guide in development of the work breakdown structure, provide visibility of those technologies that need to be further developed to perform required functions, and help identify the personnel skills required to develop and operate the architecture. It also wifi allow the systems engineering activities to totally integrate each discipline to the maximum extent possible and optimize at the total system level, thus avoiding optimizing at the element level (stove-piping). In addition, it furnishes a framework that wifi help prevent over or under specifying requirements because all functions are identified and all elements are aligned to functions.

DeHoff, Bryan↗

The Komplast Experiment: Space Environmental Effects after 12 Years in LEO (and Counting)

The Komplast materials experiment was designed by the Khrunichev State Research and Production Space Center, together with other Russian scientific institutes, and has been carried out by Mission Control Moscow since 18. Komplast panels fitted with material samples and sensors were located on the International Space Station (ISS) Functional Cargo Block (FGB) module exterior surface. Within the framework of this experiment, the purpose was to study the effect of the low earth orbit (LEO) environment on exposed samples of various materials. The panels were sent into orbit with the FGB when it launched on November 20, 1998. Panels #2 and #10 were retrieved during Russian extravehicular activity in February 2011 and sealed within cases to temporarily protect the samples from exposure to air until they could be studied on the ground. Panel #2 contained an experiment to detect micrometeoroid and orbital debris (MMOD) impacts, radiation and UV sensors, several pieces of electrical cable, and samples made from elastomeric and fluoroplastic materials. Panel #10 contained a temperature sensor, and both carbon composite and adhesive-bonded samples. A figure shows the location of panels #2 and #10 on the FGB module aft endcone. The panels were subsequently returned to Earth by Space Shuttle Discovery on the STS-133/ULF-5 mission after 12 years of LEO exposure and opened in an argon chamber at the Institute of Nuclear Physics at Moscow State University in July 2011. Based on the results of analyzing the readings from sensors located on Komplast panels and in studying material samples from the panels, the comprehensive effect of spaceflight factors on the FGB (at the locations of Panels #2 and #10) was evaluated. Total solar exposure was determined to be 960 +/- 200 kJ/square cm or 21,000 equivalent solar hours. Because of location of these two panels and the ISS flight attitude, atomic oxygen (AO) fluence was relatively low for such a long duration exposure, approximately 1.5x10 (exp 21) O atoms/sq. cm. Most of the AO fluence occurred during the early phase of ISS assembly. Temperatures ranged from a maximum of 107 C to a minimum of -80 C. The MMOD environment was determined, as is shown. Interestingly, the distribution of craters and low-velocity impact particles observed in the 5-50 micron size range was approx 2-3 orders of magnitude higher than that predicted by the ORDEM2000 model of natural and artificial origin microparticles in the ISS orbit. Contamination observations were also made, through the evaluation of optical properties on thermal control coatings and by the examination of visible deposits located near several samples on the panels, primarily from elastomeric samples. These elastomer samples were extensively investigated for their physical property changes and sealing capability. In addition, 16 samples of adhesive-bonded joints using three types of epoxy adhesive were evaluated studying fracture toughness, failure surface, and adhesive volume properties. Both rubber and adhesive-bonded specimens also underwent additional (post-flight) ground-based exposures to simulate a total 30 years in LEO prior to their evaluation. Overall, results indicate that space environmental effects will not adversely impact the service life of the FGB through 2028. Our investigation is complete and a summary of the results obtained from this uniquely long-duration exposure experiment will be presented.

Shaevich, S. K.↗

Integrated Multi-Satellite Evaluation for the Global Precipitation Measurement: Impact of Precipitation Types on Spaceborne Precipitation Estimation

Integrated multi-sensor assessment is proposed as a novel approach to advance satellite precipitation validation in order to provide users and algorithm developers with an assessment adequately coping with the varying performances of merged satellite precipitation estimates. Gridded precipitation rates retrieved from space sensors with quasi-global coverage feed numerous applications ranging from water budget studies to forecasting natural hazards caused by extreme events. Characterizing the error structure of satellite precipitation products is recognized as a major issue for the usefulness of these estimates. The Global Precipitation Measurement (GPM) mission aims at unifying precipitation measurements from a constellation of low-earth orbiting (LEO) sensors with various capabilities to detect, classify and quantify precipitation. They are used in combination with geostationary observations to provide gridded precipitation accumulations. The GPM Core Observatory satellite serves as a calibration reference for consistent precipitation retrieval algorithms across the constellation. The propagation of QPE uncertainty from LEO active/passive microwave (PMW) precipitation estimates to gridded QPE is addressed in this study, by focusing on the impact of precipitation typology on QPE from the Level-2 GPM Core Observatory Dual-frequency Precipitation Radar (DPR) to the Microwave Imager (GMI) to Level-3 IMERG precipitation over the Conterminous U.S. A high-resolution surface precipitation used as a consistent reference across scales is derived from the ground radar-based Multi-Radar/Multi-Sensor. While the error structure of the DPR, GMI and subsequent IMERG is complex because of the interaction of various error factors, systematic biases related to precipitation typology are consistently quantified across products. These biases display similar features across Level-2 and Level-3, highlighting the need to better resolve precipitation typology from space and the room for improvement in global-scale precipitation estimates. The integrated analysis and framework proposed herein applies more generally to precipitation estimates from sensors and error sources affecting low-earth orbiting satellites and derived gridded products.

Rainfall↗

Integrated Multi-satellite Evaluation for the Global Precipitation Measurement: Impact of Precipitation Types on Spaceborne Precipitation Estimation

An integrated multi-sensor assessment is proposed as a novel approach to advance satellite precipitation validation in order to provide users and algorithm developers with an assessment adequately coping with the varying performances of merged satellite precipitation estimates. Gridded precipitation rates retrieved from space sensors with quasi-global coverage feed numerous applications ranging from water budget studies to forecasting natural hazards caused by extreme events. Characterizing the error structure of satellite precipitation products is recognized as a major issue for the usefulness of these estimates. The Global Precipitation Measurement (GPM) mission aims at unifying precipitation measurements from a constellation of low-earth orbiting (LEO) sensors with various capabilities to detect, classify and quantify precipitation. They are used in combination with geostationary observations to provide gridded precipitation accumulations. The GPM Core Obser­vatory satellite serves as a calibration reference for consistent precipitation retrieval algorithms across the constellation. The propagation of QPE uncertainty from LEO active/passive microwave (PMW) precipitation estimates to gridded QPE is addressed in this study, by focusing on the impact of precipitation typology on QPE from the Level-2 GPM Core Observatory Dual-frequency Precipitation Radar (DPR) to the Microwave Imager (GMI) to Level-3 IMERG precipitation over the Conterminous U.S. A high-resolution surface precipitation used as a consistent reference across scales is derived from the ground radar-based Multi-Radar/Multi­Sensor. While the error structure of the DPR, GMI and subsequent IMERG is complex because of the interaction of various error factors, systematic biases related to precipitation typology are consistently quantified across products. These biases display similar features across Level-2 and Level-3, highlighting the need to better resolve precipitation typology from space and the room for improvement in global­scale precipitation estimates. The integrated analysis and framework proposed herein applies more generally to precipitation estimates from sensors and error sources affecting low-earth orbiting satellites and derived gridded products.

Pierre-Emmanuel Kirstette↗

The Stratospheric Aerosol and Gas Experiment (SAGE) IV

Atmospheric composition continues to be a key Earth science focus for international space agencies and research organizations. The target constituent varies depending upon the topic area of interest such as monitoring the ozone layer and the efficacy of the Montreal Protocol, assessing the influence of volcanic eruptions and large wildfires on the atmosphere, improving our knowledge of transport processes, or evaluating the impacts of greenhouse gases on climate. Additionally, there is a growing need for measurement continuity of many trace gases both from an inability to properly assess long-term trends without it as well as the reliance of reanalyses and chemistry climate models on observational input. To this end, proper continuity requires continuous and overlapping multi-instrument data records of which spaceborne measurements are a critical component. However, most current satellite systems are well beyond their expected lifetimes, and so we look toward the future to develop the Stratospheric Aerosol and Gas Experiment (SAGE) IV as a future mission concept. Enabled by the NASA Earth Science Technology Office’s (ESTO) Instrument Incubator Program, the SAGE IV Pathfinder project developed and validated a prototype demonstration that paves the way for a future SAGE IV spaceflight mission. Utilizing solar occultation imaging, SAGE IV will be capable of measuring key species in the stratosphere and upper troposphere with the same quality as previous SAGE instruments but with greatly improved pointing knowledge and extensibility to new science targets. The precision and stability of a well-designed occultation instrument can act as a calibration reference standard for other spaceborne instruments, ensuring proper continuity of the desired science targets. Furthermore, current technological advancements allow SAGE IV to fit within a CubeSat framework and make use of commercial hardware, significantly reducing the size and cost when compared with traditional missions and enabling sustainability of future measurements.

Robert Damadeo↗

Community-Based Services that Facilitate Interoperability and Intercomparison of Precipitation Datasets from Multiple Sources

Over the past 12 years, large volumes of precipitation data have been generated from space-based observatories (e.g., TRMM), merging of data products (e.g., gridded 3B42), models (e.g., GMAO), climatologies (e.g., Chang SSM/I derived rain indices), field campaigns, and ground-based measuring stations. The science research, applications, and education communities have greatly benefited from the unrestricted availability of these data from the Goddard Earth Sciences Data and Information Services Center (GES DISC) and, in particular, the services tailored toward precipitation data access and usability. In addition, tools and services that are responsive to the expressed evolving needs of the precipitation data user communities have been developed at the Precipitation Data and Information Services Center (PDISC) (http://disc.gsfc.nasa.gov/precipitation or google NASA PDISC), located at the GES DISC, to provide users with quick data exploration and access capabilities. In recent years, data management and access services have become increasingly sophisticated, such that they now afford researchers, particularly those interested in multi-data set science analysis and/or data validation, the ability to homogenize data sets, in order to apply multi-variant, comparison, and evaluation functions. Included in these services is the ability to capture data quality and data provenance. These interoperability services can be directly applied to future data sets, such as those from the Global Precipitation Measurement (GPM) mission. This presentation describes the data sets and services at the PDISC that are currently used by precipitation science and applications researchers, and which will be enhanced in preparation for GPM and associated multi-sensor data research. Specifically, the GES-DISC Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni) will be illustrated. Giovanni enables scientific exploration of Earth science data without researchers having to perform the complicated data access and match-up processes. In addition, PDISC tool and service capabilities being adapted for GPM data will be described, including the Google-like Mirador data search and access engine; semantic technology to help manage large amounts of multi-sensor data and their relationships; data access through various Web services (e.g., OPeNDAP, GDS, WMS, WCS); conversion to various formats (e.g., netCDF, HDF, KML (for Google Earth)); visualization and analysis of Level 2 data profiles and maps; parameter and spatial subsetting; time and temporal aggregation; regridding; data version control and provenance; continuous archive verification; and expertise in data-related standards and interoperability. The goal of providing these services is to further the progress towards a common framework by which data analysis/validation can be more easily accomplished.

Liu, Zhong↗

Archiving Microgravity Flight Data and Samples

To obtain help in evaluating its current strategy for archiving data and samples obtained in microgravity research, NASA's Microgravity Science and Applications Division (MSAD) asked the Space Studies Board's Committee on Microgravity Research for guidance on the following questions: What data should be archived and where should it be kept? In what form should the data be maintained (electronic files, photographs, hard copy, samples)? What should the general format of the database be? To what extent should it be universally accessible and through what mechanisms? Should there be a period of time for which principal investigators have proprietary access? If so, how long should proprietary data be stored? What provisions should be made for data obtained from ground-based experiments? What should the deadline be for investigators placing their data in the archive? How long should data be saved? How long should data be easily accessible? As a prelude to making recommendations for optimum selection and storage of microgravity data and samples, the committee in this report briefly describes NASA's past archiving practices and outlines MSAD's current archiving strategy. Although the committee found that only a limited number of experiments have thus far been archived, it concluded that the general archiving strategy, characterized by MSAD as minimalist, appears viable. A central focus of attention is the Experiment Data Management Plan (EDMP), MSAD's recently instituted data management and archiving framework for flight experiments. Many of the report's recommendations are aimed at enhancing the effectiveness of the EDMP approach, which the committee regards as an appropriate data management method for MSAD. Other recommendations provide guidance on broader issues related to the questions listed above. This report does not address statutory or regulatory records retention requirements.

Source record↗

NASA System Safety Handbook: System Safety Framework and Concepts for Implementation - Volume 1

System safety assessment is defined in NPR 8715.3C, NASA General Safety Program Requirements as a disciplined, systematic approach to the analysis of risks resulting from hazards that can affect humans, the environment, and mission assets. Achievement of the highest practicable degree of system safety is one of NASA's highest priorities. Traditionally, system safety assessment at NASA and elsewhere has focused on the application of a set of safety analysis tools to identify safety risks and formulate effective controls.1 Familiar tools used for this purpose include various forms of hazard analyses, failure modes and effects analyses, and probabilistic safety assessment (commonly also referred to as probabilistic risk assessment (PRA)). In the past, it has been assumed that to show that a system is safe, it is sufficient to provide assurance that the process for identifying the hazards has been as comprehensive as possible and that each identified hazard has one or more associated controls. The NASA Aerospace Safety Advisory Panel (ASAP) has made several statements in its annual reports supporting a more holistic approach. In 2006, it recommended that "... a comprehensive risk assessment, communication and acceptance process be implemented to ensure that overall launch risk is considered in an integrated and consistent manner." In 2009, it advocated for "... a process for using a risk-informed design approach to produce a design that is optimally and sufficiently safe." As a rationale for the latter advocacy, it stated that "... the ASAP applauds switching to a performance-based approach because it emphasizes early risk identification to guide designs, thus enabling creative design approaches that might be more efficient, safer, or both." For purposes of this preface, it is worth mentioning three areas where the handbook emphasizes a more holistic type of thinking. First, the handbook takes the position that it is important to not just focus on risk on an individual basis but to consider measures of aggregate safety risk and to ensure wherever possible that there be quantitative measures for evaluating how effective the controls are in reducing these aggregate risks. The term aggregate risk, when used in this handbook, refers to the accumulation of risks from individual scenarios that lead to a shortfall in safety performance at a high level: e.g., an excessively high probability of loss of crew, loss of mission, planetary contamination, etc. Without aggregated quantitative measures such as these, it is not reasonable to expect that safety has been optimized with respect to other technical and programmatic objectives. At the same time, it is fully recognized that not all sources of risk are amenable to precise quantitative analysis and that the use of qualitative approaches and bounding estimates may be appropriate for those risk sources. Second, the handbook stresses the necessity of developing confidence that the controls derived for the purpose of achieving system safety not only handle risks that have been identified and properly characterized but also provide a general, more holistic means for protecting against unidentified or uncharacterized risks. For example, while it is not possible to be assured that all credible causes of risk have been identified, there are defenses that can provide protection against broad categories of risks and thereby increase the chances that individual causes are contained. Third, the handbook strives at all times to treat uncertainties as an integral aspect of risk and as a part of making decisions. The term "uncertainty" here does not refer to an actuarial type of data analysis, but rather to a characterization of our state of knowledge regarding results from logical and physical models that approximate reality. Uncertainty analysis finds how the output parameters of the models are related to plausible variations in the input parameters and in the modeling assumptions. The evaluation of unrtainties represents a method of probabilistic thinking wherein the analyst and decision makers recognize possible outcomes other than the outcome perceived to be "most likely." Without this type of analysis, it is not possible to determine the worth of an analysis product as a basis for making decisions related to safety and mission success. In line with these considerations the handbook does not take a hazard-analysis-centric approach to system safety. Hazard analysis remains a useful tool to facilitate brainstorming but does not substitute for a more holistic approach geared to a comprehensive identification and understanding of individual risk issues and their contributions to aggregate safety risks. The handbook strives to emphasize the importance of identifying the most critical scenarios that contribute to the risk of not meeting the agreed-upon safety objectives and requirements using all appropriate tools (including but not limited to hazard analysis). Thereafter, emphasis shifts to identifying the risk drivers that cause these scenarios to be critical and ensuring that there are controls directed toward preventing or mitigating the risk drivers. To address these and other areas, the handbook advocates a proactive, analytic-deliberative, risk-informed approach to system safety, enabling the integration of system safety activities with systems engineering and risk management processes. It emphasizes how one can systematically provide the necessary evidence to substantiate the claim that a system is safe to within an acceptable risk tolerance, and that safety has been achieved in a cost-effective manner. The methodology discussed in this handbook is part of a systems engineering process and is intended to be integral to the system safety practices being conducted by the NASA safety and mission assurance and systems engineering organizations. The handbook posits that to conclude that a system is adequately safe, it is necessary to consider a set of safety claims that derive from the safety objectives of the organization. The safety claims are developed from a hierarchy of safety objectives and are therefore hierarchical themselves. Assurance that all the claims are true within acceptable risk tolerance limits implies that all of the safety objectives have been satisfied, and therefore that the system is safe. The acceptable risk tolerance limits are provided by the authority who must make the decision whether or not to proceed to the next step in the life cycle. These tolerances are therefore referred to as the decision maker's risk tolerances. In general, the safety claims address two fundamental facets of safety: 1) whether required safety thresholds or goals have been achieved, and 2) whether the safety risk is as low as possible within reasonable impacts on cost, schedule, and performance. The latter facet includes consideration of controls that are collective in nature (i.e., apply generically to broad categories of risks) and thereby provide protection against unidentified or uncharacterized risks.

Dezfuli, Homayoon↗

Improving Reanalyses Using TRMM and SSM/I-Derived Precipitation and Total Precipitable Water Observations

Global reanalyses currently contain significant errors in the primary fields of the hydrological cycle such as precipitation, evaporation, moisture, and the related cloud fields, especially in the tropics. The Data Assimilation Office (DAO) at the NASA Goddard Space Flight Center has been exploring the use of rainfall and total precipitable water (TPW) observations from the Tropical Rainfall Measuring Mission (TRMM) Microwave Imager (TMI) and the Special Sensor Microwave/ Imager (SSM/I) instruments to improve these fields in reanalyses. The DAO has developed a "1+1"D procedure to assimilate 6-hr averaged rainfall and TPW into the Goddard Earth Observing System (GEOS) Data Assimilation System (DAS). The algorithm is based on a 6-hr time integration of a column version of the GEOS DAS. The "1+1" designation refers to one spatial dimension plus one temporal dimension. The scheme minimizes the least-square differences between the satellite-retrieved rain rates and those produced by the column model over the 6-hr analysis window. The control variables are analysis increments of moisture within the Incremental Analysis Update (IAU) framework of the GEOS DAS. This 1+1D scheme, in its generalization to four dimensions, is related to the standard 4D variational assimilation but differs in its choice of the control variable. Instead of estimating the initial condition at the beginning of the assimilation cycle, it estimates the constant IAU forcing applied over a 6-hr assimilation cycle. In doing so, it imposes the forecast model as a weak constraint in a manner similar to the variational continuous assimilation techniques. We present results from an experiment in which the observed rain rate and TPW are assumed to be "perfect". They show that assimilating the TMI and SSM/I-derived surface precipitation and TPW observations improves not only the precipitation and moisture fields but also key climate parameters directly linked to convective activities such as clouds, the outgoing longwave radiation, and the large-scale circulation in the tropics. In particular, assimilating these data types reduce the state-dependent systematic errors in the assimilated products. The improved analysis also leads to a better short-range forecast, but the impact is modest compared with improvements in the time-averaged fields. These results suggest that, in the presence of biases and other errors of the forecast model, it is possible to improve the time-averaged "climate content" in the assimilated data without comparable improvements in the short-range forecast skill. Results of this experiment provide a useful benchmark for evaluating error covariance models for optimal use of these data types.

Hou, Arthur Y.↗