Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Decision tree”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

CropManage Application for Vineyard Irrigation Decision-Support

CropManage is a free web-application developed by U.C. Cooperative Extension to support evapotranspiration based irrigation scheduling and nutrient management for major specialty crops. Prescribed phenology curves are used to develop daily estimates of canopy cover within a given field, based on days since planting (annual crops) or budbreak (trees, vines). These curves are modulated by a MaxCan parameter representing seasonal maximum canopy cover. Crop development observations can be used to adjust for such factors as weather anomalies or non-standard agronomic practice, as needed. Canopy cover is converted to crop coefficient and combined with reference evapotranspiration to derive daily water consumption. Guidance on crop water requirement is then conveyed to users in terms of system runtime issued on-demand for a given date, largely based on total evapotranspiration since last irrigation event. In this study, CropManage was adapted to vineyards by adding modules accounting for early-season soil moisture depletion and cover crop presence. A crop stress parameter was added to accommodate deficit irrigation practice, allowing the user to specify percentage departure from full water requirement along with start/stop dates. An initial verification exercise was performed on three winegrape vineyards located in California’s Central Coast (2020), North Coast (2020) and Central Valley (2019). Daily crop evapotranspiration was monitored by eddy-covariance fluxtowers. MaxCan was measured by ground and satellite observation. Stress regime was specified by grower practice where available, otherwise stress levels were inferred from applied water records. Mean absolute error and mean bias error of modeled cumulative evapotranspiration were computed with respect to the eddy covariance measurements collected throughout the growing season. Results indicate the modified CropManage water management module performs reasonably well for winegrape. Additional effort is planned to modify the nutrient module for vineyard use.

CropManage↗

Fault Tree Based Diagnosis with Optimal Test Sequencing for Field Service Engineers

When field service engineers go to customer sites to service equipment, they want to diagnose and repair failures quickly and cost effectively. Symptoms exhibited by failed equipment frequently suggest several possible causes which require different approaches to diagnosis. This can lead the engineer to follow several fruitless paths in the diagnostic process before they find the actual failure. To assist in this situation, we have developed the Fault Tree Diagnosis and Optimal Test Sequence (FTDOTS) software system that performs automated diagnosis and ranks diagnostic hypotheses based on failure probability and the time or cost required to isolate and repair each failure. FTDOTS first finds a set of possible failures that explain exhibited symptoms by using a fault tree reliability model as a diagnostic knowledge to rank the hypothesized failures based on how likely they are and how long it would take or how much it would cost to isolate and repair them. This ordering suggests an optimal sequence for the field service engineer to investigate the hypothesized failures in order to minimize the time or cost required to accomplish the repair task. Previously, field service personnel would arrive at the customer site and choose which components to investigate based on past experience and service manuals. Using FTDOTS running on a portable computer, they can now enter a set of symptoms and get a list of possible failures ordered in an optimal test sequence to help them in their decisions. If facilities are available, the field engineer can connect the portable computer to the malfunctioning device for automated data gathering. FTDOTS is currently being applied to field service of medical test equipment. The techniques are flexible enough to use for many different types of devices. If a fault tree model of the equipment and information about component failure probabilities and isolation times or costs are available, a diagnostic knowledge base for that device can be developed easily.

Iverson, David L.↗

Accounting for Point Estimate Uncertainty in Space Systems Reliability and Risk Analysis

Understanding and accounting for uncertainty in risk analysis is a critical step in the management and communication of risk in engineered systems. The component and system-level analysis to determine the probability of a negative outcome and its consequence is often quantified by a point estimate. Many Program and Enterprise decisions involving technical concerns and issues rely on reliability engineering activities to produce quantified risk analysis to inform the decision making process. At NASA, it is common to use a Probabilistic Risk Analysis (PRA) to inform the overall risk to Loss of Mission or Loss of Crew that involves integration across all spacecraft subsystem fault trees to produce an overall probability of mission failure. The point estimate is an estimate of this overall probability and is an immediate result of a fault tree model. It is the result of a model where the probability of each event is taken to be equal to its mean. The value provides an approximation of the overall mean without running any uncertainty calculations (e.g., no sampling). Using only the point estimate can lead to a false sense of precision and the point estimate may not match the resulting mean when uncertainty is taken into consideration. This paper will explore five conditions that can cause the PRA model mean to diverge from the point estimate and will provide engineers and managers insight into the importance of understanding uncertainty in the elements of PRA models.

Paul J Collier↗

Generalized Symbolic Execution for Model Checking and Testing

Modern software systems, which often are concurrent and manipulate complex data structures must be extremely reliable. We present a novel framework based on symbolic execution, for automated checking of such systems. We provide a two-fold generalization of traditional symbolic execution based approaches: one, we define a program instrumentation, which enables standard model checkers to perform symbolic execution; two, we give a novel symbolic execution algorithm that handles dynamically allocated structures (e.g., lists and trees), method preconditions (e.g., acyclicity of lists), data (e.g., integers and strings) and concurrency. The program instrumentation enables a model checker to automatically explore program heap configurations (using a systematic treatment of aliasing) and manipulate logical formulae on program data values (using a decision procedure). We illustrate two applications of our framework: checking correctness of multi-threaded programs that take inputs from unbounded domains with complex structure and generation of non-isomorphic test inputs that satisfy a testing criterion. Our implementation for Java uses the Java PathFinder model checker.

Khurshid, Sarfraz↗

Adaptive Stress Testing: Finding Likely Failure Events with Reinforcement Learning

Finding the most likely path to a set of failure states is important to the analysis of safety-critical systems that operate over a sequence of time steps, such as aircraft collision avoidance systems and autonomous cars. In many applications such as autonomous driving, failures cannot be completely eliminated due to the complex stochastic environment in which the system operates.As a result, safety validation is not only concerned about whether a failure can occur, but also discovering which failures are most likely to occur. This article presents adaptive stress testing (AST), a framework for finding the most likely path to a failure event in simulation. We consider a general black box setting for partially observable and continuous-valued systems operating in an environment with stochastic disturbances. We formulate the problem as a Markov decision process and use reinforcement learning to optimize it. The approach is simulation-based and does not require internal knowledge of the system, making it suitable for black-box testing of large systems. We present different formulations depending on whether the state is fully observable or partially observable. In the latter case, we present a modified Monte Carlo tree search algorithm that only requires access to the pseudorandom number generator of the simulator to overcome partial observability. We also present an extension of the framework, called differential adaptive stress testing (DAST), that can find failures that occur in one system but not in another. This type of differential analysis is useful in applications such as regression testing, where we are concerned with finding areas of relative weakness compared to a baseline. We demonstrate the effectiveness of the approach on an aircraft collision avoidance application, where a prototype aircraft collision avoidance system is stress tested to find the most likely scenarios of near mid-air collision.

Verification and Validation↗

Satellite sound broadcast propagation studies and measurements

Satellite Sound Broadcasting is an attractive satellite application. Before regulatory decisions can be made in 1992, the propagation effects encountered have to be characterized. The Electrical Engineering Research Laboratory has nearly completed a system which will allow amplitude measurements to be made over 10 MHz bandwidths in the 800 to 1800 MHz frequency range. The system uses transmission from a transportable tower, and reception inside buildings or in the shadow of trees or utility poles. The goal is to derive propagation models for use by systems engineers who are about to design satellite broadcast systems. The advance of fiber-optics technology has helped to focus future development of satellite services into areas where satellites are uniquely competitive. One of these preferred satellite applications is the broadcasting of high-quality sound for stationary or mobile reception by listeners using low-cost, consumer-grade receivers. Before such services can be provided, however, the political hurdles of spectrum allocation have to be surmounted and the technical questions of standardization for world-wide compatibility have to be resolved. In order to arrive at an optimal system design, efficient in the use of our scarce spectral resources, affordable both to the broadcaster and the listener, and providing predictable performance, the propagation effects to which the service is subjected have to be characterized. Consequently, the objective of the research project is to make basic propagation measurements for direct Satellite Sound Broadcasting Service (SSBS). The data obtained should allow the development of propagation models to be used by communications engineers designing the operational systems. Such models shall describe the effects of shadowing and multipath propagation on SSBS receivers operating in a specified environment, such as inside commercial or residential buildings of various construction and also in the shadow of trees or utility poles as might be encountered by transporting or mobile listeners.

Vogel, Wolfhard J.↗

Central Park Ecological Conservation: Assessing Tree Health Conditions in New York City’s Central Park with NASA Earth Observation Data

The Central Park Conservancy stewards New York City’s iconic Central Park with a mission to preserve the park for all. This mission is complicated by the spread of Dutch elm disease (DED) which has threatened the culturally and ecologically significant American elm tree (Ulmus americana). Central Park is home to one of the largest and last remaining urban concentrations of American elm and the Conservancy currently protects them through integrated pest management. This paper discusses an interdisciplinary feasibility study that assessed the application of NASA Earth observations from 2014 to 2023 to detect changes in forest phenology possibly related to DED. Landsat 8 and 9 imagery was used to calculate multiyear time series of the Normalized Difference Vegetation Index (NDVI) and quantify changes in land surface phenology for a given year. A pixel-based logistic regression analysis was performed using changes in NDVI, tree site locations, and recorded occurrences of trees infected with DED as inputs. The results of this analysis show that changes in NDVI derived from Landsat data are capable of detecting unhealthy tree canopies with 71% precision and healthy tree canopies with 41% precision. The study had uncertainties and limitations due to the spatial and temporal resolutions of Landsat, the natural variability in land surface phenology and NDVI, and the attempt to detect disease impacts while disease prevention and mitigation is occurring. As is, the findings of this study and its methods provide managers with an approach for integrating Earth observations to make more informed decisions in the application and timing of urban forest management activities.

Central Park↗

Assessing Tree Health Conditions in New York City’s Central Park with Earth Observation Data

The Central Park Conservancy stewards New York City’s iconic Central Park with a mission to preserve the park for all. This mission is complicated by the spread of Dutch elm disease (DED) which has threatened the culturally and ecologically significant American elm tree (Ulmus americana). Central Park is home to one of the largest and last remaining urban concentrations of American elm and the Conservancy currently protects them through integrated pest management. This project is an interdisciplinary feasibility study that assessed the application of NASA Earth observations from 2014 to 2023 to detect changes in forest phenology possibly related to DED. Landsat 8 and 9 imagery was used to calculate a multiyear time series of the Normalized Difference Vegetation Index (NDVI) and quantify changes in land surface phenology. A pixel-based logistic regression analysis was performed using changes in NDVI, tree site locations, and recorded occurrences of trees infected with DED as inputs. The results of this analysis show that changes in NDVI derived from Landsat data are capable of detecting unhealthy tree canopies with 71% precision and healthy tree canopies with 41% precision. The study had uncertainties and limitations due to the spatial and temporal resolutions of Landsat, the natural variability in land surface phenology and NDVI, and the attempt to detect disease impacts while disease prevention and mitigation are occurring. As is, the findings of this study and its methods provide managers with an approach for integrating Earth observations to make more informed decisions in the application and timing of urban forest management activities.

John Hocknell↗

An integrated approach to system design, reliability, and diagnosis

The requirement for ultradependability of computer systems in future avionics and space applications necessitates a top-down, integrated systems engineering approach for design, implementation, testing, and operation. The functional analyses of hardware and software systems must be combined by models that are flexible enough to represent their interactions and behavior. The information contained in these models must be accessible throughout all phases of the system life cycle in order to maintain consistency and accuracy in design and operational decisions. One approach being taken by researchers at Ames Research Center is the creation of an object-oriented environment that integrates information about system components required in the reliability evaluation with behavioral information useful for diagnostic algorithms. Procedures have been developed at Ames that perform reliability evaluations during design and failure diagnoses during system operation. These procedures utilize information from a central source, structured as object-oriented fault trees. Fault trees were selected because they are a flexible model widely used in aerospace applications and because they give a concise, structured representation of system behavior. The utility of this integrated environment for aerospace applications in light of our experiences during its development and use is described. The techniques for reliability evaluation and failure diagnosis are discussed, and current extensions of the environment and areas requiring further development are summarized.

Patterson-Hine, F. A.↗

Application of Risk Assessment Tools in the Continuous Risk Management (CRM) Process

Marshall Space Flight Center (MSFC) of the National Aeronautics and Space Administration (NASA) is currently implementing the Continuous Risk Management (CRM) Program developed by the Carnegie Mellon University and recommended by NASA as the Risk Management (RM) implementation approach. The four most frequently used risk assessment tools in the center are: (a) Failure Modes and Effects Analysis (FMEA), Hazard Analysis (HA), Fault Tree Analysis (FTA), and Probabilistic Risk Analysis (PRA). There are some guidelines for selecting the type of risk assessment tools during the project formulation phase of a project, but there is not enough guidance as to how to apply these tools in the Continuous Risk Management process (CRM). But the ways the safety and risk assessment tools are used make a significant difference in the effectiveness in the risk management function. Decisions regarding, what events are to be included in the analysis, to what level of details should the analysis be continued, make significant difference in the effectiveness of risk management program. Tools of risk analysis also depends on the phase of a project e.g. at the initial phase of a project, when not much data are available on hardware, standard FMEA cannot be applied; instead a functional FMEA may be appropriate. This study attempted to provide some directives to alleviate the difficulty in applying FTA, PRA, and FMEA in the CRM process. Hazard Analysis was not included in the scope of the study due to the short duration of the summer research project.

Paul S. Ray↗

Predictive Modeling to Assess and Address Challenges and Limitations Associated with Clinical Care and Decision Support in Deep Space

Probabilistic risk assessment (PRA) is a method for assessing and integrating the risk of failure in a multivariate system. While it is often applied by engineers designing complex machines, it could also be applied to humans to assess the probability of a health “failure” treating diseases as the multiple “variables” and the human as the “complex machine.” The Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) was developed to apply PRA to assess medical risk for exploration spaceflight and inform the design of medical systems for space flight. The NASA engineering community utilizes event-driven and fault tree probabilistic techniques to classify risk in the space flight environment by leveraging the inherent knowledge of complex space flight system design and testing to quantify risk. However, in harmonizing the risk of human space flight, answering the question of “How do we balance astronaut health, performance and resource risks with other engineering risks on exploration space missions?” remains a profoundly challenging and largely qualitative practice. The Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) is one aspect of the Human Research Program’s efforts to represent space fight human health and performance risks quantitatively.

L Mcintyre↗

Field Evaluation of the Baseline Integrated Arrival, Departure, and Surface (IADS) Capabilities at Charlotte Douglas International Airport (CLT)

NASA is currently developing a suite of decision support capabilities for integrated arrival, departure, and surface (IADS) operations in a metroplex environment. The effort is being made in three phases, under NASA's Airspace Technology Demonstration 2 (ATD-2) sub-project, through a strong partnership with the Federal Aviation Administration (FAA), air carriers, airport, and general aviation community. The Phase 1 Baseline IADS capabilities provide enhanced operational efficiency and predictability of flight operations through data exchange and integration, tactical surface metering, and automated coordination of release time of controlled flights for overhead stream insertion. The users of the IADS system include the personnel at the Charlotte Douglas International Airport (CLT) air traffic control tower, American Airlines ramp tower, CLT terminal radar approach control (TRACON), and Washington Center. This paper describes the Phase 1 Baseline IADS capabilities and field evaluation conducted at CLT from September 2017 for a year. From the analysis of operations data, it is estimated that 538,915 kilograms of fuel savings, and 1,659 metric tons of CO2 emission reduction were achieved during the period with a total of 944 hours of engine run time reduction. The amount of CO2 savings is estimated as equivalent to planting 42,560 urban trees. The results have also shown that the surface metering had no negative impact on on-time arrival performance of both outbound and inbound flights. The technology transfer of Phase 1 Baseline IADS capabilities has been made to the FAA and aviation industry, and the development of additional capabilities for the subsequent phases is underway.

and Surface (IADS)↗

Reliability and Probabilistic Risk Assessment - How They Play Together

Since the Space Shuttle Challenger accident in 1986, NASA has extensively used probabilistic analysis methods to assess, understand, and communicate the risk of space launch vehicles. Probabilistic Risk Assessment (PRA), used in the nuclear industry, is one of the probabilistic analysis methods NASA utilizes to assess Loss of Mission (LOM) and Loss of Crew (LOC) risk for launch vehicles. PRA is a system scenario based risk assessment that uses a combination of fault trees, event trees, event sequence diagrams, and probability distributions to analyze the risk of a system, a process, or an activity. It is a process designed to answer three basic questions: 1) what can go wrong that would lead to loss or degraded performance (i.e., scenarios involving undesired consequences of interest), 2) how likely is it (probabilities), and 3) what is the severity of the degradation (consequences). Since the Challenger accident, PRA has been used in supporting decisions regarding safety upgrades for launch vehicles. Another area that was given a lot of emphasis at NASA after the Challenger accident is reliability engineering. Reliability engineering has been a critical design function at NASA since the early Apollo days. However, after the Challenger accident, quantitative reliability analysis and reliability predictions were given more scrutiny because of their importance in understanding failure mechanism and quantifying the probability of failure, which are key elements in resolving technical issues, performing design trades, and implementing design improvements. Although PRA and reliability are both probabilistic in nature and, in some cases, use the same tools, they are two different activities. Specifically, reliability engineering is a broad design discipline that deals with loss of function and helps understand failure mechanism and improve component and system design. PRA is a system scenario based risk assessment process intended to assess the risk scenarios that could lead to a major/top undesirable system event, and to identify those scenarios that are high-risk drivers. PRA output is critical to support risk informed decisions concerning system design. This paper describes the PRA process and the reliability engineering discipline in detail. It discusses their differences and similarities and how they work together as complementary analyses to support the design and risk assessment processes. Lessons learned, applications, and case studies in both areas are also discussed in the paper to demonstrate and explain these differences and similarities.

Safie, Fayssal↗

Establishing an Urban Heat Exposure Severity Index for Infrastructure Prioritization in Tempe, Arizona, Using NASA Earth Observations and LiDAR

Located on the banks of the Salt River in the Sonoran Desert, Tempe, Arizona, features a semi-arid climate with summer daily maximum temperatures regularly exceeding 37.8°C. Tempe is also subject to the southwestern monsoon season from July-September and the humidity exacerbates the high temperatures. Furthermore, the rapid urbanization experienced in Tempe has resulted in an intensification of the urban heat island. The summer of 2020 shattered the previous record of days exceeding 43.4°C, leading to higher energy and water costs, lower comfort, and increased risk of heat stroke for residents. Recognizing the impacts of extreme heat, the City of Tempe partnered with the Healthy Urban Environments initiative and NASA DEVELOP to identify census tracts that experience a higher mean land surface temperature than the city average. The NASA DEVELOP team used remotely sensed land surface temperature (LST), normalized difference vegetation index (NDVI), normalized difference built-up index (NDBI), normalized difference water index (NDWI), and albedo data calculated from Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) and Landsat 8 Operational Land Imager (OLI) and Thermal Infrared Sensor (TIRS) instruments from 2015 to 2020 to create heat hazard and exposure maps. LiDAR point cloud data, provided by the United States Geological Survey through Arizona State University’s Map and Geospatial Hub, were used to derive 3D buildings, building footprints, and tree point data for a shading analysis of walking paths, roads, and buildings at the census tract level. In situ meteorological measurements including air temperature and humidity were used to compare the macro-scale temperature measurements. The team worked with the City of Tempe to develop a methodology to process available data and identify areas of highest concern for urban heat effects within the city. With these insights, Tempe, Arizona can better address these issues with data-driven information to make decisions regarding heat mitigation and adaptation efforts.

John Dialesandro↗

Source Data Applicability Impacts on Epistemic Uncertainty for Launch Vehicle Fault Tree Models

Launch vehicle systems are designed and developed using both heritage and new hardware. Design modifications to the heritage hardware to fit new functional system requirements can impact the applicability of heritage reliability data. Risk estimates for newly designed systems must be developed from generic data sources such as commercially available reliability databases using reliability prediction methodologies, such as those addressed in MIL-HDBK-217F. Failure estimates must be converted from the generic environment to the specific operating environment of the system where it is used. In addition, some qualification of applicability for the data source to the current system should be made. Characterizing data applicability under these circumstances is crucial to developing model estimations that support confident decisions on design changes and trade studies. This paper will demonstrate a data-source applicability classification method for assigning uncertainty to a target vehicle based on the source and operating environment of the originating data. The source applicability is determined using heuristic guidelines while translation of operating environments is accomplished by applying statistical methods to MIL-HDK-217F tables. The paper will provide a case study example by translating Ground Benign (GB) and Ground Mobile (GM) to the Airborne Uninhabited Fighter (AUF) environment for three electronic components often found in space launch vehicle control systems. The classification method will be followed by uncertainty-importance routines to assess the need to for more applicable data to reduce uncertainty.

Al Hassan, Mohammad↗

Source Data Impacts on Epistemic Uncertainty for Launch Vehicle Fault Tree Models

Launch vehicle systems are designed and developed using both heritage and new hardware. Design modifications to the heritage hardware to fit new functional system requirements can impact the applicability of heritage reliability data. Risk estimates for newly designed systems must be developed from generic data sources such as commercially available reliability databases using reliability prediction methodologies, such as those addressed in MIL-HDBK-217F. Failure estimates must be converted from the generic environment to the specific operating environment of the system in which it is used. In addition, some qualification of applicability for the data source to the current system should be made. Characterizing data applicability under these circumstances is crucial to developing model estimations that support confident decisions on design changes and trade studies. This paper will demonstrate a data-source applicability classification method for suggesting epistemic component uncertainty to a target vehicle based on the source and operating environment of the originating data. The source applicability is determined using heuristic guidelines while translation of operating environments is accomplished by applying statistical methods to MIL-HDK-217F tables. The paper will provide one example for assigning environmental factors uncertainty when translating between operating environments for the microelectronic part-type components. The heuristic guidelines will be followed by uncertainty-importance routines to assess the need for more applicable data to reduce model uncertainty.

Al Hassan, Mohammad↗

Enabling Assurance in the MBSE Environment

A number of specific benefits that fit within the hallmarks of effective development are realized with implementation of model-based approaches to systems and assurance. Model Based Systems Engineering (MBSE) enabled by standardized modeling languages (e.g., SysML®) is at the core. These benefits in the context of spaceflight system challenges can include [1]: • Improved management of complex development • Reduced risk in the development process • Improved cost management • Improved design decisions With appropriate modeling techniques the assurance community also can improve early oversight and insight into project development. NASA has shown the basic constructs of SysML in an MBSE environment offer several key advantages, within a Model Based Mission Assurance (MBMA) initiative [2, 3]. These include the following: • Model viewpoints that promote rapid and systematic assessment of requirements coverage, hazard tagging and risk management • Embedded safety assessments for launch vehicles • Deployment of model assisted development of reliability products - Failure Modes and Effects Analyses (FMEAs) and Fault Trees • Test Planning • Validation and Verification of complex functions • Support of Assurance Case development for complex systems In addition, while there are benefits to be harvested, there is a realization that these do not come without effort and cost. Enabling model-based approaches requires structure, not only in an organizational context, but in a modeling context as well. There can be a steep learning curve and costs associated to train skilled modelers. But, on the other hand, not all of the assurance community need to be modelers. Models themselves must conform to ontologies that enable assurance. This places constraints upon the models and modelers. Optimums have yet to be developed where resources and constraints on modeling must be traded off in the organization and modeling efforts for projects. A number of barriers need to be overcome, as well, which pose challenges to the developers of the software that supports MBSE/MBMA. Information and data must be made to flow seamlessly through the life cycle. Because there is a wide variety of tools used in the community, to avoid the problems of the past of silos, delays, and diverging interests, information should flow among these tools to support the “single source of truth” paradigm of MBSE. This will greatly facilitate MBMA and advancement of assurance functions.

Evans, John W.↗

Using Remote Sensing Data and Research Results for Urban Heat Island Mitigation

This paper provides information on the characteristics of the urban heat island, research designed to provide the data needed to develop effective urban heat island reduction strategies, and the development of local working groups to develop implementation plans. As background, an overview of research results on the urban heat island phenomenon and the resultant effect on energy usage and air quality will be explored. The use of more reflective roofing materials, paving materials, tree planting, and other initiatives will be explored as a basis for strategies to mitigate urban heat islands and improve the urban environment. Current efforts to use aircraft remote sensing data in Atlanta, Baton Rouge, Sacramento, and Salt Lake City and our work with non-profit organizations designated to lead public education and strategic development efforts will be presented. Efforts to organize working groups comprised of key stakeholders, the process followed in communicating research results, and methodology for soliciting feedback and incorporating ideas into local plans, policies and decision-making will be discussed. Challenges in developing and transferring data products and research results to stakeholders will be presented. It is our ultimate goal that such efforts be integrated into plans and/or decision models that encourage sustainable development.

Estes, Maury↗