Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed teams”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

The Application of Remote Sensing using NASA Earth Observations paired with Sociodemographic Indicators to Identify Communities Most Susceptible to Urban Heat Exposure in Austin, Texas

In recent years, Austin, Texas has experienced an increase in population and urban development. Additionally, the City’s climate—already characterized by periods of extreme heat and drought—continues to change. As temperatures and demand for utilities and cooling resources rise, the number of heat-related deaths and illnesses in socially vulnerable populations (e.g., older, lower-income populations) is expected to increase. The City of Austin, The University of Texas at Austin (UT Austin), and The University of Texas Health Science Center at Houston (UT Health) partnered with NASA DEVELOP to examine the distribution of urban heat throughout the City. This project used land surface temperature, greenness, plant water content, and urban surface material analysis parameters derived from NASA Earth observations from Landsat 8 Operational Land Imager (OLI), Landsat 8 Thermal Infrared Sensor (TIRS), and Aqua and Terra Moderate Resolution Imaging Spectroradiometer (MODIS). The project team produced three different indices to create a spatial analysis for the study area including a social vulnerability index (SoVI), heat exposure index (HEI), and an overall heat priority index (HPI) score. This overall score was determined with a weighted analysis of heat-related environmental variables from NASA Earth observations and socioeconomic data from the 2019 American Community Survey. Based on the HPI score, the project team identified 121 census block groups out of 605 total that are designated as being most at risk of adverse impacts from extreme heat events. To test the sensitivity of the HPI, the team used a Monte Carlo analysis using different approaches for geographic scale, variable inclusion, census uncertainty, and index aggregation. Based on the sensitivity analysis, the resulting HPI score showed the metric was consistent with the baseline HPI. This provided increased confidence the score can be used as a tool to make informed infrastructure improvement plans in targeted areas (e.g., siting of cooling centers) and ensure equitable sustainable development.

Ryan Hammock↗

VIPER: Systems Integration Status

NASA’s Artemis Program plans to return humans to the Moon for an extended stay. To do so will require substantial resources to sustain that continued human presence, including continuous supplies delivered from the Earth. Given the expense and complexity of resource deliveries from Earth, if some resources were indigenously available, substantial logistical savings could be available by “living off the land”, wherever possible. The LCROSS[1] , LRO and other missions have confirmed the presence of resources such as water-ice and other volatiles in lunar polar regions, so the next step is to understand the scientific nature and physical distribution of those candidate resources. Those local volatiles could be processed into propellants and human life-supporting needs, reducing risk of maintaining a permanent human presence on the Moon. The Volatiles Investigating Polar Exploration Resource (VIPER) is a surface mobility scientific platform, designed to spend ~100 days mapping and surveying four different Ice Stability Regions to understand the scientific nature and distribution of water and other volatiles. VIPER will also provide scientific mineralogical context of the lunar regolith, such as the presence of silicon and light metals in lunar regolith, providing a composite picture of resource availability and sustainment. This paper will discuss the latest systems-level integration activities by the VIPER team, following our initial introduction to this mission at IAC2021[2] . The VIPER team successfully passed its Systems Integration Review (SIR) in late-2022, and in early 2023, began system-level surface segment (rover) flight hardware assembly. VIPER is managed within NASA’s Science Mission Directorate (SMD), utilizing the Commercial Lunar Payload Services (CLPS) lunar delivery model with partner, Astrobotic, Inc.

VIPER↗

UNITY: Unified Memory and Storage Space

UNITY is a 36-month project focused on providing design and evaluate a new distributed storage paradigm that unifies the traditionally distinct application views of memory- and file-based data storage into a single scalable and resilient environment. The project is a collaboration among Oak Ridge National Laboratory (ORNL, Lead institution), Los Alamos National Labs (LANL), and Georgia Tech (GT). The main contributions of the GT team have been around development of low level systems software for best leveraging the capabilities of new types of persistent memory technologies, and for development of methods for intelligent data management across memory/storage substrates with heterogeneous components. GT contributed the Phoenix library for optimized checkpoint/restart for HPC I/O for systems with non-volatile memory (NVM), the NVStream library for NVM-specialized streaming I/O for HPC workflows, the CoMerge, Mnemo and Kleio solutions for intelligent data management on NVM-based systems. These contributions result in significant improvements in both application performance and system efficiency.

97 MATHEMATICS AND COMPUTING↗

VTK-m User's' Guide (V.1.7)

High-performance computing relies on ever finer threading. Advances in processor technology include ever greater numbers of cores, hyperthreading, accelerators with integrated blocks of cores, and special vectorized instructions, all of which require more software parallelism to achieve peak performance. Traditional visualization solutions cannot support this extreme level of concurrency. Extreme scale systems require a new programming model and a fundamental change in how we design algorithms. To address these issues we created VTK-m: the visualization toolkit for multi-/many-core architectures. VTK-m supports a number of algorithms and the ability to design further algorithms through a top-down design with an emphasis on extreme parallelism. VTK-m also provides support for finding and building links across topologies, making it possible to perform operations that determine manifold surfaces, interpolate generated values, and find adjacencies. Although VTK-m provides a simplified high-level interface for programming, its template-based code removes the overhead of abstraction. VTK-m simplifies the development of parallel scientific visualization algorithms by providing a framework of supporting functionality that allows developers to focus on visualization operations. Consider the listings in Figure 1.1 that compares the size of the implementation for the Marching Cubes algorithm in VTK-m with the equivalent reference implementation in the CUDA software development kit. Because VTK-m internally manages the parallel distribution of work and data, the VTK-m implementation is shorter and easier to maintain. Additionally, VTK-m provides data abstractions not provided by other libraries that make code written in VTK-m more versatile.This book includes contributions from the VTK-m community including the VTK-m development team and the user community.

97 MATHEMATICS AND COMPUTING↗

Application of SCALE to Molten Salt Fueled Reactor Physics in Support of Severe Accident Analyses

As part of a US Nuclear Regulatory Commission–sponsored project to assess the modeling and simulation capabilities for accident progression, source term, and consequence analysis for advanced reactor technologies with SCALE and MELCOR, SCALE was used for the modeling and simulation of a molten salt-fueled reactor (MSR). SCALE capabilities for the modeling of MSR physics were demonstrated based on the Molten Salt Reactor Experiment (MSRE). Of primary interest were the determination of the system’s nuclide inventory, as well as the inventories in the various regions of the loop, considering that the fuel is continuously pumped through the system. This report contains discussions on the following: 1. Determination of the system-average fuel salt inventory considering fission gas removal in the off-gas system and noble metal removal through plating out at the heat exchanger using recent enhancements in SCALE’s depletion sequence TRITON, 2. Assessment of the nuclide spatial distribution throughout the loop using SCALE’s depletion solver ORIGEN, 3. Calculation of the core’s power profile, flux profile, temperature reactivity coefficients, and xenon reactivity using full-core calculations with SCALE’s Monte Carlo code KENO-VI. The results obtained with SCALE were post-processed to provide the MELCOR team with the core inventory and decay heat of the system, as well as the inventory and decay heat of individual regions in the loop, a zone-wise power profile, temperature feedback coefficients, and the xenon worth.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The fortedata R package: open-science datasets from a manipulative experiment testing forest resilience

The fortedata R package is an open data notebook from the Forest Resilience Threshold Experiment (FoRTE) – a modeling and manipulative field experiment that tests the effects of disturbance severity and disturbance type on carbon cycling dynamics in a temperate forest. Package data consist of measurements of carbon pools and fluxes and ancillary measurements to help analyze and interpret carbon cycling over time. Currently the package includes data and metadata from the first three FoRTE field seasons, serves as a central, updatable resource for the FoRTE project team, and is intended as a resource for external users over the course of the experiment and in perpetuity. Further, it supports all associated FoRTE publications, analyses, and modeling efforts. This increases efficiency, consistency, compatibility, and productivity while minimizing duplicated effort and error propagation that can arise as a function of a large, distributed and collaborative effort. More broadly, fortedata represents an innovative, collaborative way of approaching science that unites and expedites the delivery of complementary datasets to the broader scientific community, increasing transparency and reproducibility of taxpayer-funded science. The fortedata package is available via GitHub: https://github.com/FoRTExperiment/fortedata (last access: 19 February 2021), and detailed documentation on the access, used, and applications of fortedata are available at https://fortexperiment.github.io/fortedata/ (last access: 19 February 2021). The first public release, version 1.0.1 is also archived at https://doi.org/10.5281/zenodo.4399601 (Atkins et al., 2020b). All data products are also available outside of the package as .csv files: https://doi.org/10.6084/m9.figshare.13499148.v1 (Atkins et al., 2020c).

97 MATHEMATICS AND COMPUTING↗

Lacie phase 1 Classification and Mensuration Subsystem (CAMS) rework experiment

An experiment was designed to test the ability of the Classification and Mensuration Subsystem rework operations to improve wheat proportion estimates for segments that had been processed previously. Sites selected for the experiment included three in Kansas and three in Texas, with the remaining five distributed in Montana and North and South Dakota. The acquisition dates were selected to be representative of imagery available in actual operations. No more than one acquisition per biophase were used, and biophases were determined by actual crop calendars. All sites were worked by each of four Analyst-Interpreter/Data Processing Analyst Teams who reviewed the initial processing of each segment and accepted or reworked it for an estimate of the proportion of small grains in the segment. Classification results, acquisitions and classification errors and performance results between CAMS regular and ITS rework are tabulated.

Chhikara, R. S.↗

Blackboard system generator (BSG) - An alternative distributed problem-solving paradigm

A status review is presented for a generic blackboard-based distributed problem-solving environment in which multiple-agent cooperation can be effected. This environment is organized into a shared information panel, a chairman control panel, and a metaplanning panel. Each panel contains a number of embedded AI techniques that facilitate its operation and that provide heuristics for solving the underlying team-agent decision problem. The status of these panels and heuristics is described along with a number of robustness considerations. The techniques for each of the three panels and for four sets of paradigm-related advances are described, along with selected results from classroom teaching experiments and from three applications.

Silverman, Barry G.↗

BOREAS TE-5 Tree Ring and Carbon Isotope Ratio Data

The BOREAS TE-5 team collected several data sets to investigate the vegetation-atmosphere CO2 and H2O exchange processes. These data include tree ring widths and cellulose carbon isotope data from coniferous trees collected at the BOREAS NSA and SSA in 1993 and 1994 by the BOREAS TE-5 team. Ring width data are provided for both Picea mariana and Pinus banksiana. The carbon isotope data are provided only for Pinus banksiana. The data are provided in tabular ASCII files. The data files are available on a CD-ROM (see document number 20010000884), or from the Oak Ridge National Laboratory (ORNL) Distributed Active Archive Center (DAAC).

Hall, Forrest G.↗

Studies of Antarctic Sea Ice Concentrations from Satellite Data and Their Applications

Large changes in the sea ice cover have been observed recently. Because of the relevance of such changes to climate change studies it is important that key ice concentration data sets used for evaluating such changes are interpreted properly. High and medium resolution visible and infrared satellite data are used in conjunction with passive microwave data to study the true characteristics of the Antarctic sea ice cover, assess errors in currently available ice concentration products, and evaluate the applications and limitations of the latter in polar process studies. Cloud-free high resolution data provide valuable information about the natural distribution, stage of formation, and composition of the ice cover that enables interpretation of the large spatial and temporal variability of the microwave emissivity of Antarctic sea ice. Comparative analyses of co-registered visible, infrared and microwave data were used to evaluate ice concentrations derived from standard ice algorithms (i.e., Bootstrap and Team) and investigate the 10 to 35% difference in derived values from large areas within the ice pack, especially in the Weddell Sea, Amundsen Sea, and Ross Sea regions. Landsat and OLS data show a predominance of thick consolidated ice in these areas and show good agreement with the Bootstrap Algorithm. While direct measurements were not possible, the lower values from the Team Algorithm results are likely due to layering within the ice and snow and/or surface flooding, which are known to affect the polarization ratio. In predominantly new ice regions, the derived ice concentration from passive microwave data is usually lower than the true percentage because the emissivity of new ice changes with age and thickness and is lower than that of thick ice. However, the product provides a more realistic characterization of the sea ice cover, and are more useful in polar process studies since it allows for the identification of areas of significant divergence and polynya activities. Also, heat and salinity fluxes are proportionately increased in these areas compared to those from the thicker ice areas. A slight positive trend in ice extent and area from 1978 through 2000 is observed consistent with slight continental cooling during the period. However, the confidence in this result is only moderate because the overlap period for key instruments is just one month and the sensitivity to changes in sensor characteristics, calibration and threshold for the ice edge is quite high.

Comiso, Josefino C.↗

Establishing a Technical Assistance Network to Build Capacity in Southwest Alaska (Southwest Alaska Energy Network - Final Report)

The Southwest Alaska Municipal Conference (SWAMC) is a non-profit regional membership economic development organization that represents the Aleutian/Pribilof Islands, Bristol Bay, and Kodiak regions of southwest Alaska. SWAMC applied for the DOE-OIE Establishment of an Inter-Tribal Technical Assistance Energy Providers Network grant FOA to work with our partners to provide energy planning and project development technical assistance. The project team was made up of SWAMC, three regional organizations, a management consulting firm, and a panel of technical consultants. SWAMC sub-contracted with the three Alaska Native regional non-profit organizations – Aleutian Pribilof Islands Association (APIA), Bristol Bay Native Association (BBNA), and Kodiak Area Native Association (KANA) – to fund full or partial Regional Energy Coordinator (REC) positions. The project period ran from September 2016 to March 2020. The project goal was to help southwest Alaska regional tribal partners and communities to develop efficient and financially sustainable structures for identifying and developing energy projects that enhance community resiliency and energy sustainability. This project established energy coordinators and management structures in the Aleutian, Bristol Bay, and Kodiak regions to expand technical assistance capacity of regional residents; demonstrate this capacity by advancing energy efficiency, heat, and power supply projects; and secure long-term funding commitments to establish a sustained technical assistance structure. The project team expanded technical assistance capacity of energy coordinators and regional stakeholders in several ways: by providing funding for the SWAMC project manager to attend three Office of Indian Energy trainings; for energy coordinators to attend numerous energy conferences; for utility clerks from several villages to receive one-on-one reporting training on Alaska’s Power Cost Equalization electric subsidy program; and for the Kodiak REC to complete the Arctic Remote Energy Networks Academy and NREL’s Executive Energy Leadership Academy. The energy coordinators demonstrated and shared their increased capacity by hosting several public events: SWAMC hosted two full-day energy workshops in February 2017 and 2018; the Kodiak REC hosted seven Energy Committee meetings for Kodiak stakeholders and gave several presentations at other events; and SWAMC and BBNA organized a Bristol Bay Regional Energy Visioning Session in May 2019. The project team created platforms to both share and request information to involve energy stakeholders in this project, including an energy website, a Facebook group, a periodic newsletter, surveys, mass emails, and paper mailers. An increase in regional capacity was demonstrated through several grant awards, including a $1.2 million USDA grant for Akhiok for an electric distribution infrastructure replacement; an AHFC Kickstarter grant for Aleknagik to audit 2 Tribal and 3 City buildings; and installation of an Air Source Heat Pump demonstration project in Atka. Two communities and one region – Ouzinkie (May 2017), Ugashik (July 2017), and the Bristol Bay region (May 2019) – utilized DOE’s technical assistance services to hold Strategic Energy Planning sessions with NREL and DOE facilitation assistance. And in early 2018, SWAMC established a parallel program, funded through a USDA Energy Audit and Renewable Energy Development grant to provide subsidized energy audits for small businesses in the region. SWAMC and partners have now completed energy audits of over 60 businesses (buildings and fishing vessels) and are currently operating a third round of the USDA program. Fifteen of those business owners have now received additional grant funding to cover 25% of the cost of the energy efficiency upgrades identified in the audit. This technical assistance structure will be sustained beyond DOE grant funding in several forms. As a sign of increased grant writing and project management capacity, the Kodiak Regional Energy Coordinator applied for and received a USDA Community Facilities Technical Assistance and Training grant to continue work begun under this program. Energy coordination tasks have been folded into existing economic development positions at SWAMC and at BBNA, ensuring long-term outreach and support in the region.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

U.S. Department of Energy (DOE) Enabling Extreme Real-Time Grid Integration of Solar Energy (ENERGISE) Project: Multiday and Intraday Energy Availability Product [Slides]

This presentation will provide an overview of the development of a Multi-Day Energy Availability Product under the DOE ENERGISE project, conducted in collaboration with Southwest Power Pool (SPP), the National Laboratory of the Rockies, Polaris, and the Electric Power Research Institute (EPRI). Existing market clearing processes are limited to day-ahead and real-time horizons, which may result in insufficient pricing signals and compensation for resource availability over multi-day timeframes (e.g., incentives for fuel procurement and energy-limited resource preparedness). This effort aims to develop a new market product and associated clearing process to value and procure resource energy availability over a multi-day horizon. The team will present progress to date and solicit advisory group feedback on proposed methodologies and preliminary findings.

14 SOLAR ENERGY↗

Improved AIRS/AMSU Surface and Atmospheric Soundings Under Partial Cloud Cover Using an AIRS Only Cloud Clearing Approach

AIRS was launched on EOS Aqua on May 4,2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. This paper describes the latest scientific advances made in the AIRS Science Team Version 5.0 retrieval algorithm. Starting in early 2007, the Goddard DAAC will use this algorithm to analyze near real time AIRS/AMSU observations. These products are then made available to the scientific community for research purposes. The products include twice daily measurements of the Earth's three dimensional global temperature, water vapor, and ozone distribution as well as cloud cover. In addition, accurate twice daily measurements of the earth's land and ocean temperatures are derived and reported. Scientists use this important set of observations for two major uses. They provide important information for climate studies of global and regional variability and trends of different aspects of the earth's atmosphere. They also provide information for researchers to improve the skill of weather forecasting. A very important new product of the AIRS Version 5 algorithm is accurate case-by-case error estimates of the retrieved products. This heightens their utility for use in both weather and climate applications. These error estimates are also used directly for quality control of the retrieved products.

Susskind, Dr. Joel↗

Recent Theoretical Advances in Analysis of AIRS/AMSU Sounding Data

AIRS was launched on EOS Aqua on May 4,2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. This paper describes the AIRS Science Team Version 5.0 retrieval algorithm. Starting in early 2007, the Goddard DAAC will use this algorithm to analyze near real time AIRS/AMSU observations. These products are then made available to the scientific community for research purposes. The products include twice daily measurements of the Earth's three dimensional global temperature, water vapor, and ozone distribution as well as cloud cover. In addition, accurate twice daily measurements of the earth's land and ocean temperatures are derived and reported. Scientists use this important set of observations for two major applications. They provide important information for climate studies of global and regional variability and trends of different aspects of the earth's atmosphere. They also provide information for researchers to improve the skill of weather forecasting. A very important new product of the AIRS Version 5 algorithm is accurate case-by-case error estimates of the retrieved products. This heightens their utility for use in both weather and climate applications. These error estimates are also used directly for quality control of the retrieved products. Version 5 also allows for accurate quality controlled AIRS only retrievals, called "Version 5 AO retrievals" which can be used as a backup methodology if AMSU fails. Examples of the accuracy of error estimates and quality controlled retrieval products of the AIRS/AMSU Version 5 and Version 5 AO algorithms are given, and shown to be significantly better than the previously used Version 4 algorithm. Assimilation of Version 5 retrievals are also shown to significantly improve forecast skill, especially when the case-by-case error estimates are utilized in the data assimilation process.

Susskind, Joel↗

MODIS Collection 6 MAIAC Algorithm

This paper describes the latest version of the algorithm MAIAC (Multi-Angle Implementation of Atmospheric Correction) used for processing the MODIS (Moderate-resolution Imaging Spectroradiometer) Collection6 data record. Since initial publication in 2011-2012, MAIAC has changed considerably to adapt to global processing and improve cloud/snow detection, aerosol retrievals and atmospheric correction of MODIS data. The main changes include (1) transition from a 25 to 1 km scale for retrieval of the spectral regression coefficient (SRC) which helped to remove occasional blockiness at 25 km scale in the aerosol optical depth (AOD) and in the surface reflectance, (2) continuous improvements of cloud detection, (3) introduction of smoke and dust tests to discriminate absorbing fine- and coarse mode aerosols, (4) adding over-water processing, (5) general optimization of the LUT (LookUp-Table)-based radiative transfer for the global processing, and others. MAIAC provides an interdisciplinary suite of atmospheric and land products, including cloud mask (CM), column water vapor (CWV), AOD at 0.47 and 0.55 m, aerosol type (background, smoke or dust) and fine-mode fraction over water; spectral bidirectional reflectance factors (BRF), parameters of Ross-thick Lisparse (RTLS) bidirectional reflectance distribution function (BRDF) model and instantaneous albedo. For snow-covered surfaces, we provide subpixel snow fraction and snow grain size. All products come in standard HDF4 (software library) format at 1 km resolution, except for BRF, which is also provided at 500 m resolution on a sinusoidal grid adopted by the MODIS Land team. All products are provided on per-observation basis in daily files except for the BRDF/Albedo product, which is reported every 8 days. Because MAIAC uses a time series approach, BRDF/Albedo is naturally gap-filled over land where missing values are filled-in with results from the previous retrieval. While the BRDF model is reported for MODIS Land bands 1-7 and ocean band 8, BRF is reported for both land and ocean bands 1-12. This paper focuses on MAIAC cloud detection, aerosol retrievals and atmospheric correction and describes MCD19 data products and quality assurance (QA) flags.

MAIAC Algorithm↗

Airspace Technology Demonstration 3 (ATD-3): Dynamic Routes for Arrivals in Weather (DRAW) Technology Transfer Document Summary Version 2.0

Airspace Technology Demonstration – 3 (ATD-3) is part of NASA’s Airspace Operations and Safety Program (AOSP) – specifically, its Airspace Technology Demonstrations (ATD) Project. ATD-3 is a multi-year research and development effort which proposes to develop and demonstrate automation technologies and operating concepts that enable air navigation service providers and airspace users to continuously assess weather, winds, traffic, and other information to identify, evaluate, and implement workable opportunities for flight plan route corrections that can result in significant flight time and fuel savings in en route airspace. In order to ensure that the products of this tech-transfer are relevant and useful, NASA has created strong partnerships with the FAA and key industry stakeholders. This summary document and accompanying technology artifacts satisfy the third Research Transition Product (RTP) defined in the Applied Traffic Flow Management (ATFM) Research Transition Team (RTT) Plan, which is Dynamic Routes for Arrivals in Weather (DRAW). This technology transfer consists of artifacts for DRAW Arrival Metering (AM) Operations delivered in June 2018, DRAW AM updates, and DRAW Extended Metering (XM) Operations. Blue highlighting indicates the new or modified deliverables. Some of the artifacts in this technology transfer have distribution restrictions that need to be followed. Distribution information is noted in each section. DRAW is a trajectory-based system that combines the legacy Dynamic Weather Routes (DWR) weather avoidance technology with an arrival-specific rerouting algorithm and arrival scheduler to improve traffic flows on weather-impacted arrival routes into major airports. First, DRAW identifies flights that could be rerouted to more efficient Standard Terminal Arrival Routes (STARs) that may have previously been impacted by weather. Second, when weather is impacting the arrival routing, DRAW proposes simple arrival route corrections that enable aircraft to stay on their flight plan while avoiding weather. The DRAW system proposes reroutes early enough to allow Time Based Flow Management (TBFM) to make the necessary schedule adjustments. As a result, metering operations can be sustained longer and more consistently in the presence of weather because the arrival schedule accounts for the dynamic routing intent of arrival flights to deviate around weather. The first DRAW tech transfer in June 2018 focused on arrival metering operations with the DRAW algorithm implemented in the NASA Center TRACON Automation System (CTAS) automation software. This tech transfer delivery includes updates for DRAW implemented in FAA’s TBFM 4.7 automation software and preliminary research into DRAW for XM operations.

Isaacson, Douglas R.↗

Stochastic Verification by Analysis for Autonomous Systems Management Architecture (ASMA)

The Gateway Vehicle Systems Manager (VSM) is the top-level of a distributed, hierarchical software control system. VSM is data-driven and will make decisions related to mission, fault, resource management and vehicle control. These attributes combined with a high degree of autonomy make it susceptible to emergent behavior. In order to achieve the high level of confidence needed in this critical system, the VSM team has developed a multifaceted verification strategy employing traditional verification techniques, simulation, model checking, and runtime verification. Individual algorithms are verified using conventional testing and model checking using assume-guarantee contracts. A discrete event-based simulation approach is being developed to verify timelines. This presentation describes an enhancement to the verification approach using analysis to enhance system robustness by detecting and resolving the potential for emergent behavior. The verification by analysis employs a Software in the Loop (SITL) environment with real flight software executing on emulated processors, simulations of vehicle subsystems, flight dynamics, and human inputs. Since the possible input space and configuration data set are too large for exhaustive testing, a Monte Carlo approach is used to cover feasible scenarios, augmented with corner cases and known higher-risk scenarios. A key problem in using Monte Carlo-based system verification is evaluating test results to ensure that system behavior is correct. The presentation describes the approach the VSM team uses to monitor behavior for compliance with predetermined boundaries and to identify anomalous behavior for further analysis. This presentation describes the multi-level systems approach to verification, and the simulation-based layer that covers the feasible state space: 1. Overview of the Gateway VSM 2. Special challenges due to heterogeneous, hierarchical architecture 3. Modeling and simulation environment using flight software and system simulations 4. Developing input sets to ensure state-space coverage 5. Developing model and data configuration sets to ensure model coverage 6. Interpreting results without predetermined outcomes 7. Lessons learned and future work

Verification and Validation↗