Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Stakeholder”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

cabbi-bio/BECT-ABM

The emergence of the cellulosic bioeconomy requires not only adequate technological, economic, and policy advances, but also effective communication and coordination among the multiple stakeholders in the bioeconomy community. Aiming to facilitate stakeholder communication and collaboration for cellulosic bioeconomy growth, an agent-based model is developed as a community communication tool in this study. The tool simulates the behaviors and interactions of key stakeholders, as well as the responses and interactions between the stakeholders and biophysical, socioeconomic, and environmental conditions. The agent behavior rules are developed and validated based on behavior and economic theories and information attained from a stakeholder focus group study and a land use survey.

Yang, Pan↗

Development and implementation of energy efficiency standards and labeling programs in China: Progress and challenges

Over the last twenty years, with growing policy emphasis on improving energy efficiency and reducing environmental pollution and carbon emissions, China has implemented a series of new minimum energy performance standards (MEPS) and mandatory and voluntary energy labels to improve appliance energy efficiency. As China begins planning for the next phase of standards and labeling (S&L) program development under the 12th Five Year Plan, an evaluation of recent program developments and future directions is needed to identify gaps that still exist when compared with international best practices. The review of China’s S&L program development and implementation in comparison with major findings from international experiences reveal that there are still areas of improvement, particularly when compared to success factors observed across leading international S&L program. China currently lacks a formalized regulatory process for standard-setting and do not have any legal or regulatory guidance on elements of S&L development such as stakeholder participation or the issue of legal precedence between conflicting national, industrial and local standards. Consequently, China’s laws regarding standard-setting and management of the mandatory energy label program could be updated, as they have not been amended or revised recently and no longer reflects the current situation. While China uses similar principles for choosing target products as the U.S., Australia, EU and Japan, including high energy-consumption, mature industry and testing procedure and stakeholder support, recent MEPS revisions have generally aimed at only eliminating the bottom 20% efficiency of the market. Setting a firm principle based on maximizing energy savings that are technically feasible and economically justified may help improve the stringency of China’s MEPS program and reduce the need for frequent revisions. China also lacks robust survey data and relies primarily on market research data in relatively simple techno-economic analyses used to determine its efficiency standards levels rather than the specific sets of analyses and tools used internationally. Based on international experiences, inclusion of more detailed energy consumption surveys in the Chinese national census surveys and statistical reporting systems could help provide the necessary data for more comprehensive standard-setting analyses. In terms of stakeholder participation in the standards development process, stakeholder participation in China is limited to membership on technical committees responsible for developing or revising standards and generally do not include environmental groups, consumer associations, utilities and other NGOs. Increasing stakeholder involvement to broader interest groups could help garner more support and feedback in the S&L implementation process. China has emerged as a leader in a national verification testing scheme with complementary pilot checktesting projects, but it still faces challenges with insufficient funding, low local awareness amongst some regulatory agencies and resistance to check-testing by some manufacturers, limited product sampling scope, and testing inconsistency and incomparability of results. Thus, further financial and staff resources and capacity building will be needed to overcome these remaining challenges and to expand impacts evaluations to assess the actual effectiveness of implementation and enforcement.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A New Appraisal- Lessons from the History of Efforts to Value Green and High-Performance Home Attributes in the United States

Rigorous consideration of green and high-performance (“green/HP”) features is rarely included in the property valuation process._ To help illuminate why this is the case, this report takes stock of the history of efforts to improve practices, and identifies barriers that have emerged and opportunities for overcoming them. Particular emphasis is placed on what energy and environmental policymakers and other stakeholders outside the appraisal community can contribute to the broader effort to advance professional practices. The history has unfolded in parallel with turbulent periods in the housing market for which appraisers and their customers are deemed to share responsibility, followed by cycles of regulations, siloing of appraisers in the name of professional integrity, and commoditization of the valuation process itself. This pattern has important ramifications for aspirations that appraisers engage more fully in identifying and valuing the green/HP characteristics of homes. On the one hand, it is legally and ethically incumbent on appraisers to do so, yet on the other hand it is perceived as a risky avenue to follow. Risks arise where findings can be challenged as either over- or under-stating value, together with a market environment in which the complexity of their assignments increases despite downward pressure on appraiser fees. While efforts to address green/HP considerations date back to the early 1980s, the vast majority of activity has taken place within the past five years. Many players have engaged in the efforts to promote improved valuation practices. These include the Appraisal Foundation, The Appraisal Institute, Colorado Energy Office, Earth Advantage, EcoBroker, Elevate Energy, Fannie Mae, Federal Housing Administration, Home Innovation Research Labs, The Institute for Market Transformation, Northwest Energy Efficiency Alliance, National Association of Homebuilders, National Association of State Energy Officials, National Association of Appraisers, RESNET, USEPA, USDOE and its National Laboratories, the U.S. Green Buildings Council, and the Vermont Green Homes Alliance. Many activities have resulted, ranging from trainings, to data-gathering instruments, and the emergence of a literature attempting to statistically isolate the effects of green/HP characteristics on home values. In some cases, the results of studies have been overgeneralized and oversold, and embodied flawed methods. Although the green/HP community has encouraged appraisers to focus on exemplary buildings (e.g., LEED or ENERGY STAR Certified), any level of green or energy performance can in fact influence value, including below-average performance (a.k.a. “brown discount”), irrespective of whether or not the building has been formally rated. This overly narrow focus represents a significant missed opportunity. Other surmountable challenges include limitations to non-appraisers’ understanding of the appraisal process (and practical constraints therein). A byproduct of this can be unrealistic expectations of what appraisers can and will do in the marketplace. These challenges notwithstanding, the environment for moving forward has improved. There is better data today (a critical need); expanded efforts to disclose energy use information (characteristics, consumption, bills); improved and more pervasive building energy codes, building rating and labeling initiatives; and a host of federal, state, and local policies that have collectively brought green/HP practices much more into the mainstream. Meanwhile, a renewed focus on professional standards of care and competency for assessing green/HP homes make it increasingly important for appraisers to consider these factors in their assignments. Despite the past four decades of studies, there is little if any discernible uptake of these practices by the appraisal practice at large. It would behoove interested parties to step back and consider what new strategies might be productive. A key element of any new plan should be to reset the nature of interactions with the industry, with the goal a more collaborative, two-way discussion to help improve outsiders’ understanding of the valuation process. It is not only the appraiser that needs to be engaged and could benefit from awareness raising. Homeowners, builders, lenders, utilities, insurance companies should also provide input on how green/HP factors impact property valuations and ways to accurately reflect these considerations in appraisals and real estate transactions more broadly. Given extensive inertia within the appraisal industry and a mixed history of interactions with the non-appraisal stakeholders, it is unlikely that the status quo will achieve much unless followed with more coordinated and persistent efforts. Workshops, studies, and memoranda of understanding will not on their own have much impact, and do not address deeper structural issues. Expectations are often unrealistic and not attentive to real-world constraints faced by appraisers. The report identifies key barriers impeding more thorough consideration of green/HP factors in residential real estate appraisals, and solutions for mitigating them. Barriers • Although industry standards of practice caution against bias of any sort, a skeptical predisposition towards “green” is reinforced by information deficiencies. • Information deficiencies result from the lack or difficulty of obtaining usable data on green/HP features in subject properties as well as valid sales comparisons or cashflow analyses. • Competency deficiencies, such as lack of conversancy in relevant technical topics, leads to oversights, and disjointed treatment of relevant information. • Time/cost pressure and process commoditization (e.g., template-based approaches) result from highly constrained budgets, quick turn-around times expected of appraisers, and standardized practices that were not developed with green/HP considerations in mind. • Professional differences between appraisers and sustainability professionals include divergent objectives, the former being market observers and the latter market influencers. • Risk aversion arises from multiple concerns including veracity, accuracy, and persistence of energy data, impacts of operational choices, new sources of appraiser liability associated with green/HP assessments, industry pressures not to over-value buildings or suggestion of bias, and concern about spending non-billable time on complex assignments. • A public policy vacuum has been created by disjointed and uncoordinated efforts from public-sector stakeholders, insufficient efforts to discuss and understand the appraisal industry and process, and a perception by some valuation professionals that green/HP is oversold. Opportunities • Elevating the competency of appraisers can be achieved through a combination of improved industry standards of care and equal-access training and professional development offerings. • Development of better information resources must focus on building-level information that provides robust documentation as well as aggregate sales-comparison data and other contextual information such as local codes, typical upgrade costs, energy prices, etc. • Improved energy benchmarking and rating tools could provide appraisers with information more well-adapted to their particular needs, which differ from those of typical audiences such as energy managers. • Better characterizing and managing risk will enable appraisers to cope with uncertainties in performance information, and help identify where risks may be introduced or mitigated by green/HP features, including higher costs or obsolescence of poorly-performing buildings. • Integrating disaster resilience and sustainability in appraisals would recognize important synergisms among these features, including durability and ability of green/HP buildings to better withstand external hazards. • Mitigating the problem of additional time/cost for performing assignments is an essential need that can be addressed by providing easier access to information and analytic procedures, perhaps coupled with new resources to defray the associated costs. • Enhancing demand for improved appraisals is a fundamental need, and depends on owners, developers, lenders, and others soliciting competent appraisers to perform scopes that expressly call out green/HP considerations, and to critically review the work product for compliance before acceptance. • Engaging new market participants, such as energy utilities and insurance companies can ensure fuller representation and participation of market stakeholders already engaged in green/HP activities and capable of furnishing valuable data and managing associated risks. Cutting across these individual activities, there is a need for outside stakeholders to formulate and follow a roadmap instead of piecemeal initiatives, bridging the professional/cultural divide between appraisers and green/HP communities, and tracking progress in order to know what is working. A more coherent communication and training strategy is needed, as the appraisal industry is highly fragmented, with two-thirds of appraisers opting out of membership in trade associations. In sum, while there is no silver bullet for advancing the practice of valuing green/HP features, there are concrete opportunities. Parties seeking solutions must identify barriers they wish to address and select from among potential initiatives that map to those barriers. Close collaboration with the appraisal community is critical, as non-appraisers have historically obtained limited traction with this industry due to lack of understanding of the nuances involved in the valuation profession. Large organizations and agencies should have a united approach; the perception or reality of a fragmented and uncoordinated strategy is unsettling for prospective partners in the appraisal industry. This requires improved communication and education within and among these communities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Status and Promise of Advanced M&V: An Overview of “M&V 2.0” Methods, Tools, and Applications

Advanced measurement and verification (M&V) of energy efficiency savings, often referred to as M&V 2.0 or advanced M&V, is currently an object of much industry attention. Thus far, however, there has been a lack of clarity about what techniques M&V 2.0 includes, how those techniques differ from traditional approaches, what the key considerations are for their use, and what value propositions M&V 2.0 presents to different stakeholders. The objective of this paper is to provide background information and frame key discussion points related to advanced M&V. The paper identifies the benefits, methods, and requirements of advanced M&V and outlines key technical issues for applying these methods. It presents an overview of the distinguishing elements of M&V 2.0 tools and of how the industry is addressing needs for tool testing, consistency, and standardization, and it identifies opportunities for collaboration. In this paper, we consider two key features of M&V 2.0: (1) automated analytics that can provide ongoing, near-real-time savings estimates, and (2) increased data granularity in terms of frequency, volume, or end-use detail. Greater data granularity for large numbers of customers, such as that derived from comprehensive implementation of advanced metering infrastructure (AMI) systems, leads to very large data volumes. This drives interest in automated processing systems. It is worth noting, however, that automated processing can provide value even when applied to less granular data, such as monthly consumption data series. Likewise, more granular data, such as interval or end-use data, delivers value with or without automated processing, provided the processing is manageable. But it is the combination of greater data detail with automated processing that offers the greatest opportunity for value. Using M&V methods that capture load shapes together with automated processing1 can determine savings in near-real time to provide stakeholders with more timely and detailed information. This information can be used to inform ongoing building operations, provide early input on energy efficiency program design, or assess the impact of efficiency by location and time of day. Stakeholders who can make use of such information include regulators, energy efficiency program administrators, program evaluators, contractors and aggregators, building owners, the investment community, and grid planners. Although each stakeholder has its own priorities and challenges related to savings measurement and verification, the potential exists for all to draw from a single set of efficiency valuation data. Such an integrated approach could provide a base consistency across stakeholder uses.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Precision Local Positioning System

The primary goal of the project is to lay the groundwork for a new system design, meaning that at the end of this project’s effort, a traditional LLNL project could begin. For this goal to be met, the overarching needs of potential sponsors and stakeholders must be analyzed and understood, and a clear statement of work should be able to be drafted from the finding in this report. More specifically, the results from this project should immediately feed into the drafting of requirements, an implementation plan, and a budget plan for a future project. In order to accomplish this goal, the team set a broad framework for work to be completed. First, conduct current market research and select reference technologies to decompose. From the decompositions, analyze shortcomings, possible pain-points and form metrics and architectural decisions. Next, analyze the potential market area by interviewing/researching stakeholders and understanding their needs. As an additional project goal, attempt to capture as large a market area and scope as reasonably possible by incorporating more than the traditional LLNL sponsors. From the information gathered, study stakeholder salience and understand the relationships between stakeholders, mission areas, mission critical functions, and system metrics. Further analyze the relationships to focus on critical system aspects and to group stakeholders and mission together in order to reduce system complexity while maintaining wide marketability. Finally, begin brainstorming concepts from the established architectural decision and use the found metrics to create tradespaces to down select the most viable architectures. This document presents the team’s findings as it progressed through the project’s strategy.

42 ENGINEERING↗

Montana Community-Scale Solar Strategy Project (Final Technical Report)

Grid-tied solar photovoltaic (PV) development began gradually in Montana, initially taking root in the early 2000s, largely in the form of small residential systems, rarely larger than two kilowatts. Utility support for solar technology through public benefit funding triggered the installation of the state’s first solar PV installations on community-owned facilities including schools, libraries, fire stations and local government buildings in the mid-2000s. By 2016, solar PV installations totaled approximately 28 megawatts of installed capacity, generating less than 0.05% of electricity sold in Montana. Montana’s solar fleet in 2016 included 17 megawatts of utility-scale solar farms, and three shared solar projects developed by rural electric cooperatives that ranged from 25 to 50 kilowatts in size. However, with only 3,000 households utilizing solar PV, either through an on-site installation or participation in a shared solar project, the potential benefits and reach of solar technology was limited. The Montana Solar Community Project (MSCP) was developed by the Montana Energy Office (MEO) at the Department of Environmental Quality in order to implement a “community-scale” solar energy strategy for the state that would cost-effectively expand Montanans’ access to solar PV. This project defines three types of community-scale solar projects: shared solar, community-sited solar, and group purchasing programs. The MSCP project conducted research and stakeholder engagement that helped to inform and develop model community-scale initiatives and an overarching community-scale solar strategy for Montana. Specifically, the project included a solar market assessment, stakeholder meetings across Montana, development of a menu of community-scale solar options, a study of solar potential on schools, community solar market research, and community-scale project implementation support. MSCP activities were successful in implementing solar projects and supporting solar development in communities across Montana. Project activities realized 280 kW of newly installed solar from two solarize programs, a shared solar array at a rural electric cooperative, and a solar array atop a Bozeman high school. The community-scale project implementation support and Solar on Schools components of the project resulted directly in the analysis and design of nearly 2 MW of distributed solar systems across the state. The Solar on Schools analysis alone produced solar designs for 25 schools, representing 920.8 kW of solar potential. Many of the deliverables from this project provide guidance on future development of community-scale solar in Montana, and resulted in a number of important conclusions about community-scale solar in Montana. There is strong interest in community-scale solar in Montana, as noted during stakeholder meetings, in response to solar market research surveys, and as seen by applications for implementation support grants provided by MEO. Project activities also suggest that Montanans demonstrated a desire and need for more information about solar energy technology, solar financing options, and the state’s policy and regulatory framework. Additionally, the project found that schools will be key partners for future community-scale solar programs. In addition to being excellent hosts for solar arrays, schools have the opportunity to use the installation of a solar array to develop educational materials and curricula to educate Montana’s future leaders about these technologies, which can be shared and replicated across the state. Project activities laid a clear path forward for solar energy in Montana. Certain activities have concrete next steps. For example, numerous solar arrays were designed for schools and other public buildings around the state. Many of those designs will be used as soon as funding becomes available. Other activities have less developed next steps, though lay the foundation for future work. The solar market assessment, solar market research, and community stakeholder meetings are good examples. These documents can be used as stepping stones to increase renewable energy education, increase stakeholder outreach, and support communities as they seek to develop community-scale solar projects.

14 SOLAR ENERGY↗

An Integrated Gate Turnaround Management Concept Leveraging Big Data Analytics for NAS Performance Improvements

"Gate Turnaround" plays a key role in the National Air Space (NAS) gate-to-gate performance by receiving aircraft when they reach their destination airport, and delivering aircraft into the NAS upon departing from the gate and subsequent takeoff. The time spent at the gate in meeting the planned departure time is influenced by many factors and often with considerable uncertainties. Uncertainties such as weather, early or late arrivals, disembarking and boarding passengers, unloading/reloading cargo, aircraft logistics/maintenance services and ground handling, traffic in ramp and movement areas for taxi-in and taxi-out, and departure queue management for takeoff are likely encountered on the daily basis. The Integrated Gate Turnaround Management (IGTM) concept is leveraging relevant historical data to support optimization of the gate operations, which include arrival, at the gate, departure based on constraints (e.g., available gates at the arrival, ground crew and equipment for the gate turnaround, and over capacity demand upon departure), and collaborative decision-making. The IGTM concept provides effective information services and decision tools to the stakeholders, such as airline dispatchers, gate agents, airport operators, ramp controllers, and air traffic control (ATC) traffic managers and ground controllers to mitigate uncertainties arising from both nominal and off-nominal airport gate operations. IGTM will provide NAS stakeholders customized decision making tools through a User Interface (UI) by leveraging historical data (Big Data), net-enabled Air Traffic Management (ATM) live data, and analytics according to dependencies among NAS parameters for the stakeholders to manage and optimize the NAS performance in the gate turnaround domain. The application will give stakeholders predictable results based on the past and current NAS performance according to selected decision trees through the UI. The predictable results are generated based on analysis of the unique airport attributes (e.g., runway, taxiway, terminal, and gate configurations and tenants), and combined statistics from past data and live data based on a specific set of ATM concept-of-operations (ConOps) and operational parameters via systems analysis using an analytic network learning model. The IGTM tool will then bound the uncertainties that arise from nominal and off-nominal operational conditions with direct assessment of the gate turnaround status and the impact of a certain operational decision on the NAS performance, and provide a set of recommended actions to optimize the NAS performance by allowing stakeholders to take mitigation actions to reduce uncertainty and time deviation of planned operational events. An IGTM prototype was developed at NASA Ames Simulation Laboratories (SimLabs) to demonstrate the benefits and applicability of the concept. A data network, using the System Wide Information Management (SWIM)-like messaging application using the ActiveMQ message service, was connected to the simulated data warehouse, scheduled flight plans, a fast-time airport simulator, and a graphic UI. A fast-time simulation was integrated with the data warehouse or Big Data/Analytics (BAI), scheduled flight plans from Aeronautical Operational Control AOC, IGTM Controller, and a UI via a SWIM-like data messaging network using the ActiveMQ message service, illustrated in Figure 1, to demonstrate selected use-cases showing the benefits of the IGTM concept on the NAS performance.

Efficent ATM systems↗

Presenting Model-Based Systems Engineering Information to Non-Modelers

NASA’s Human Research Program’s (HRP) Exploration Medical Capability (ExMC) Element adopted Systems Engineering (SE) principles and Model Based Systems Engineering (MBSE) tools to capture the system functions, system architecture, requirements, interfaces, and clinical capabilities for a future exploration medical system. There are many different stakeholders who may use the information in the model: systems engineers, requirement engineers, clinicians (doctors, nurses, and pharmacists), scientists, and program managers. Many of these individuals do not have access to MBSE modeling toolsor have never used these tools. Many of these individuals (clinicians, scientists, even program managers)may have no experience with SE in general let alone interpreting a systems model. The challenge faced by ExMC was how to present the content in the model to non-modelers in a way they could understand with limited to no training in MBSE or the Systems Modeling Language (SysML) without using the modeling tool. Therefore, from the model, ExMC created an HTML report that is accessible to anyone with a browser. When creating the HTML report, the ExMC SE team talked to stakeholders and received their feedback on what content they wanted and how to display this content. Factoring in feedback, the report arranges the content in a way that not only directs readers through the SE process taken to derive the requirements, but also helps them to understand the fundamental steps in an SE approach. The report includes links to source information (i.e., NASA documentation that describes levels of care) and other SE deliverables (e.g., Concept of Operations). These links were provided to aid in the understanding of how the team created this content through a methodical SE approach. This paper outlines the process used to develop the model, the data chosen to share with stakeholders, many of the model elements used in the report, the review process stakeholders followed, the comments received from the stakeholders, and the lessons ExMC learned through producing this HTML report.

Jeff Cohen↗

Presenting Model-Based Systems Engineering Information to Non-Modelers

NASA’s Human Research Program’s (HRP) Exploration Medical Capability (ExMC) Element adopted Systems Engineering (SE) principles and Model Based Systems Engineering (MBSE) tools to capture the system functions, system architecture, requirements, interfaces, and clinical capabilities for a future exploration medical system. There are many different stakeholders who may use the information in the model: systems engineers, clinicians (physicians, nurses, and pharmacists), scientists, and program managers. Many of these individuals do not have access to MBSE modeling tools or have never used these tools. Many of these individuals (clinicians, scientists, even program managers) may have no experience with SE in general let alone interpreting a systems model. The challenge faced by ExMC was how to present the content in the model to non-modelers in a way they could understand with limited to no training in MBSE or the Systems Modeling Language (SysML) without using the modeling tool. Therefore, from the model, ExMC created an HTML report that is accessible to anyone with a browser. When creating the HTML report, the ExMC SE team talked to stakeholders and received their feedback on what content they wanted and how to display this content. Factoring in feedback, the report arranges the content in a way that not only directs readers through the SE process taken to derive the requirements, but also helps them to understand the fundamental steps in an SE approach. The report includes links to source information (i.e., NASA documentation that describes levels of care) and other SE deliverables (e.g., Concept of Operations). These links were provided to aid in the understanding of how the team created this content through a methodical SE approach. This paper outlines the process used to develop the model, the data chosen to share with stakeholders, many of the model elements used in the report, the review process stakeholders followed, the comments received from the stakeholders, and the lessons ExMC learned through producing this HTML report.1Trade names and trademarks are used in this report for identification only. Their usage does not constitute an official endorsement, either expressed or implied, by the National Aeronautics and Space Administration.

Jeffrey R. Cohen↗

Presenting Model-Based Systems Engineering Information to Non-Modelers

NASA’s Human Research Program’s (HRP) Exploration Medical Capability (ExMC) Element adopted Systems Engineering (SE) principles and Model Based Systems Engineering (MBSE) tools to capture the system functions, system architecture, requirements, interfaces, and clinical capabilities for a future exploration medical system. There are many different stakeholders who may use the information in the model: systems engineers, clinicians (physicians, nurses, and pharmacists), scientists, and program managers. Many of these individuals do not have access to MBSE modeling tools or have never used these tools. Many of these individuals (clinicians, scientists, even program managers) may have no experience with SE in general let alone interpreting a systems model. The challenge faced by ExMC was how to present the content in the model to non-modelers in a way they could understand with limited to no training in MBSE or the Systems Modeling Language (SysML) without using the modeling tool. Therefore, from the model, ExMC created an HTML report that is accessible to anyone with a browser. When creating the HTML report, the ExMC SE team talked to stakeholders and received their feedback on what content they wanted and how to display this content. Factoring in feedback, the report arranges the content in a way that not only directs readers through the SE process taken to derive the requirements, but also helps them to understand the fundamental steps in an SE approach. The report includes links to source information (i.e., NASA documentation that describes levels of care) and other SE deliverables (e.g., Concept of Operations). These links were provided to aid in the understanding of how the team created this content through methodical SE approach. This paper outlines the process used to develop the model, the data chosen to share with stakeholders, many of the model elements used in the report, the review process stakeholders followed, the comments received from the stakeholders, and the lessons ExMC learned through producing this HTML report.

Jeffrey R. Cohen↗

Dissertation Defense: Three Papers on Organizational Decision-Making and Change at NASA Goddard Space Flight Center

This is a three-paper dissertation that responds to a call for empirical research on stakeholder influence in the implementation of evaluation recommendations. The literature is consistent but mostly theoretical: stakeholder participation should positively influence and increase the probability of implementation (see e.g., Christie, 2011; Cousins & Earl, 1992; Fetterman, 2004). In response, I use two Goddard Space Flight Center engineering technical training and development programs to build a causal argument supporting my proposition that stakeholder influence in the logic modeling process impacts organizational decision-making and change. I first introduce the logic modeling process as a tool to involve stakeholders in program and evaluation design (paper 1); then use the data collection process to implement the collaboratively constructed logic model outcomes (paper 2); and, finally, I triangulate the data using the Toal (2009) Evaluation Involvement Scale (paper 3). I do this to “increase the validity of the findings” (Noble & Heale, 2019, p. 67) and to garner potential mechanisms. I found that stakeholder participation in the logic modeling process positively influenced the use of data to inform recommendations which in turn positively influenced implementation of evaluation recommendations. I identified the process itself as the mechanism and the key decision points as links or influencers. Potential factors included power and interest (measured by role) and time-on-job.

organizational decision-making↗

Transitioning TEMPO Data for Air Quality Management Applications at the NASA SPoRT Center

The TEMPO mission has been observing air pollutants every hour during the daytime across its Field of Regard (FoR) covering greater North America since First Light on August 2, 2023. The highly anticipated public release of TEMPO data occurred on May 20, 2024, consisting of level 2 and level 3 trace gas data products of nitrogen dioxide, formaldehyde, and ozone. The NASA SPoRT Center is developing value-added products and tools to support the TEMPO mission and Early Adopters program with special attention on stakeholder from air agencies. One component of our work is focused on evaluating the TEMPO products over stakeholder target areas using Pandora and surface monitor observations to characterize the uncertainties and develop best practices for processing and analyzing TEMPO data. Methods for oversampling TEMPO data to 1 km resolution are being applied over the target areas to resolve fine-scale emission sources and pollutant gradients. Machine learning techniques using TEMPO, surface monitor, and model data to estimate surface-level nitrogen dioxide concentrations are being developed over the target areas. A SPoRT viewer for TEMPO has been launched for providing visualizations of the TEMPO products and an ArcGIS dashboard is being designed for enabling air agency stakeholders to efficiently analyze TEMPO data. Training materials including user guides are being developed to ensure the effective and sustained use of TEMPO data at our stakeholder agencies. One major goal of our TEMPO initiatives at SPoRT is to better enable the inclusion of TEMPO data in air quality management applications such as exceptional event demonstrations through our close engagement with stakeholders. This talk will provide an update on our SPoRT activities and showcase use cases of TEMPO data for monitoring different emission sources including wildland fire smoke.

Air Quality↗

A Literature Review and Compilation of Nuclear Waste Management System Attributes for Use in Multi-Objective System Evaluations.

The purpose of this work was to compile a comprehensive initial set of potential nuclear waste management system attributes. This initial set of attributes is intended to serve as a starting point for additional consideration by system analysts and planners to facilitate the development of a waste management system multi-objective evaluation framework based on the principles and methodology of multi-attribute utility analysis. The compilation is primarily based on a review of reports issued by the Canadian Nuclear Waste Management Organization (NWMO) and the Blue Ribbon Commission on America's Nuclear Future (BRC), but also an extensive review of the available literature for similar and past efforts as well. Numerous system attributes found in different sources were combined into a single objectives-oriented hierarchical structure. This study provides a discussion of the data sources and the descriptions of the hierarchical structure. A particular focus of this study was on collecting and compiling inputs from past studies that involved the participation of various external stakeholders. However, while the important role of stakeholder input in a country's waste management decision process is recognized in the referenced sources, there are only a limited number of in-depth studies of the stakeholders' differing perspectives. Compiling a comprehensive hierarchical listing of attributes is a complex task since stakeholders have multiple and often conflicting interests. The BRC worked for two years (January 2010 to January 2012) to "ensure it has heard from as many points of view as possible." The Canadian NWMO study took four years and ample resources, involving national and regional stakeholders' dialogs, internet-based dialogs, information and discussion sessions, open houses, workshops, round tables, public attitude research, website, and topic reports. The current compilation effort benefited from the distillation of these many varied inputs conducted by the previous studies.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Policy and Technology Readiness: Engaging the User and Developer Community to Develop a Research Roadmap

A key challenge for research roadmapping in the crisis response and management domain is articulation of a shared vision that describes what the future can and should include. Visioning allows for far-reaching stakeholder engagement that can properly align research with stakeholders needs. Engagement includes feedback from researchers, policy makers, general public, and end-users on technical and non-technical factors. This work articulates a process and framework for the construction and maintenance of a stakeholder-centric research vision and roadmap in the emergency management domain. This novel roadmapping process integrates three pieces: analysis of the research and technology landscape, visioning, and stakeholder engagement. Our structured engagement process elicits research foci for the roadmap based on relevance to stakeholder mission, identifies collaborators, and builds consensus around the roadmap priorities. We find that the vision process and vision storyboard helps SMEs conceptualize and discuss a technology's strengths, weaknesses, and alignment with needs

policy readiness↗

Using Prescribed Fire to Manage the Fernald On-Site Disposal Facility Vegetated Cap - 17401

The Fernald Preserve is a former uranium processing plant that underwent extensive remediation pursuant to the Comprehensive Environmental Response, Compensation, and Liability Act (CERCLA). It is situated on a 425 ha (1,050 acre) tract of land, approximately 29 km (18 miles) northwest of Cincinnati, Ohio. Remedial activities and subsequent ecological restoration have converted the site from an industrial production facility to an undeveloped park, encompassing a series of wetlands, prairies, and forested communities. The remediation of buildings and soil contamination was completed in 2006, but aquifer remediation is ongoing. Since 2007, the site has been managed by the US Department of Energy (DOE) Office of Legacy Management. Portions of the site are open to the public, with approximately 11 km (7 miles) of walking trails that are open year-round and a visitors center. Site remediation included the construction of an On-Site Disposal Facility (OSDF) for the long-term disposal of contaminated soil and building materials. The OSDF consists of eight disposal cells that encompass approximately 30 hectares (75 acres) on the eastern portion of the Fernald site. Cells are lined and capped, and each has a separate leak detection and leachate collection system. The integrated cap is vegetated with native grasses and forbs. Management of the Fernald Preserve includes the monitoring and maintenance of ecologically restored communities and the vegetated OSDF cap, as required by the site's institutional controls plan. Prescribed burning is recognized as the preferred method for prairie management. Prescribed fire has been used at the Fernald site since 2009 for established prairies in restored areas, but not on the OSDF cap. Stakeholders had reservations regarding the safety of using prescribed fire on the OSDF cap. Because of that, vegetation on the cap was managed as a grassland community. It was mowed, raked, and baled to remove thatch, and promote the continued establishment of native grasses and forbs. Since agricultural use is restricted at the site, the resulting hay bales were kept on property and reused as organic matter and mulch. Over time, more hay bales were being generated in a season than were reused. Therefore in 2015, DOE decided to revisit stakeholder acceptance of prescribed fire on the OSDF cap. Ongoing relationships with local stakeholders allowed for extensive discussions regarding the current management and proposed use of prescribed fire on the OSDF cap. The public was provided information about the planning and implementation of prescribed burns at the site and invited to observe the execution of a successful site burn. This approach led to stakeholder acceptance of DOE's proposal, and vegetation on the caps of cells 4, 5, and 6 was burned in late March 2016. The burn was successful and resulted in several benefits from a land stewardship and cost perspective. This paper details the stakeholder engagement approach and the resulting benefits from the use of prescribed fire on the OSDF cap. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Addressing an aging facility: improving reliability of the defense waste processing facility at the Savannah River Site - 15539

The High Level Waste program at the Savannah River Site significantly reduces environmental risks associated with the storage of radioactive waste from legacy efforts to separate fissionable nuclear material from irradiated targets and fuels. The Defense Waste Processing Facility treats and immobilizes High Level Waste into a durable borosilicate glass for safe, permanent storage. Construction of the facility began in 1983 and radioactive operations commenced in 1996. In an effort to support the disposition of radioactive waste and accelerate tank closure for the balance of the Savannah River Site mission, the Defense Waste Processing Facility recently underwent an extensive reliability review in 2013 to understand future needs as well as to address aging infrastructure. As a product of this review, a Performance Improvement Plan was developed to systematically address three major focus areas including, a) asset preservation, b) facility housekeeping, and 3) process improvements. Since issuance of the plan, significant progress has been made in each of these areas to improve the reliability and predictability of the Defense Waste Processing Facility. Providing consistent, constructive, and concise communications is vital in the face of a changing budgetary environment. The Savannah River Site case study provides an example of the U.S. Department of Energy - Savannah River (DOE-SR) and SRR partnering to inform stakeholders about cleanup progress at the site. DOE-SR and SRR periodically and consistently provide both annual written progress reports under the Federal Facility Agreement and quarterly written progress reports under the landfill permit to the government regulators. Through the Liquid Waste System Plans, DOE-SR and SRR constructively and concisely summarize both the significant progress made and explain how a changed budget can impact the goals moving forward. Furthermore, DOE-SR and SRR informs the community and general public about the Site's progress and future during Citizens Advisory Board meetings. In addition, through the new proposed model for complex-wide communications, stakeholders can better understand how budget constraints will affect them. The set-aside program would also encourage stakeholder participation and involvement in helping each state and site obtain extra funding through performance evaluations. Waste management organizations can benefit in a number of ways from an effective partnership approach to communicate with stakeholders about available funding. Keeping an open and honest dialogue with regulatory agencies can help preserve confidence, thus mitigating or completely avoiding costly and distracting fines and penalties. Informing the public not only promotes trust, but also spurs the public to exercise its right to demand more information and voice any concerns to elected or DOE officials. With this approach, DOE can receive better understanding and cooperation from stakeholders in a changing budgetary landscape. Furthermore, a set-aside competitive program would encourage efficiency and innovation that could lead to further cost savings for the government while providing extra funding for cleanup efforts. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Evolution of DOE/Stakeholder Relationships at the Fernald Preserve, Ohio, Site - 19559

The Fernald Preserve, Ohio, Site is managed by the US Department of Energy (DOE) Office of Legacy Management. It is approximately 29 km (18 miles) northwest of Cincinnati, Ohio, on the site of a former uranium-processing plant established by the US Atomic Energy Commission in 1951. The production mission officially ended in 1991 when it was replaced by a remediation mission. Extensive environmental remediation was subsequently conducted under the Superfund program by the DOE Office of Environmental Management. After most of the remediation was concluded in 2006, the site was transferred to the DOE Office of Legacy Management, which continued comprehensive ecological restoration and is responsible for an ongoing aquifer remediation operation. The site was renamed the Fernald Preserve and opened to the public in 2008 as an undeveloped park, encompassing a diversity of natural habitats native to the area. The site now serves as a community asset, offering a Visitors Center with exhibits that tell the site story, hiking trails, wildlife observation opportunities, meeting spaces for community groups, educational program opportunities, and Interpretive Services personnel to engage the public. There was a long history of community mistrust about government operations at the site, beginning in the 1950's when land for the site was acquired by eminent domain, and continuing when contamination and hazardous waste management concerns were revealed in the 1980's. Resulting media coverage on possible contamination and cover-up concerns was extensive. In 1986, sitewide studies to determine the nature and extent of contamination and to consider cleanup options were instigated. In 1989, the site was placed on the National Priorities List of the Superfund program. Because of the longstanding mistrust held by many stakeholders, DOE faced a very serious challenge in achieving consensus among stakeholder groups about the cleanup levels, waste disposition, and the future uses of the site. Starting in the late 1980's, DOE, the regulators, site contractors and the community took a number of steps over many years to increase trust and achieve consensus among the many stakeholder groups. These steps included establishing a single cleanup mission, involving the community early and often as a critically important stakeholder, creating a citizens taskforce and community envoys, and providing extensive educational outreach. As a result, DOE, regulators, contractors, and community members moved from a position of very little trust to one of increased trust and collaboration among all concerned parties. The lessons learned from the Fernald site can be invaluable in the resolution of difficult environmental issues and should be considered as DOE seeks increased collaboration and consensus with stakeholders to solve other environmental remediation challenges. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Interactive Visualizations for Communicating Compliance and Sustainability Statements in Annual Site Environmental Reports - 20419

The annual reports of organizations are a recurring type of public disclosure that communicates what an organization has done and/or plans to do. Worldwide, organizations use annual reports as powerful instruments for communication that is rich in narrative content and visuals. From the perspective of the leadership of an organization, statutory annual reports are communication devices to stakeholders. By analogy, from the perspective of stakeholders, the annual reports are learning devices that presents stakeholders with contents to generate knowledge about an organization. We have chosen the online accessible U.S. Department of Energy (DOE) Annual Site Environmental Reports (ASERs) as a collection of resources for communicating and learning the environmental management strategies on environmental compliance and environmental sustainability. Environmental Compliance 'consists of regulatory compliance and monitoring programs that implement federal, state, and local requirements, agreements, and permits.' Environmental Sustainability 'promotes and integrates initiatives such as energy and natural resource conservation, waste minimization, green remediation, and the use of sustainable products and services.' Interactive visualizations of textual data designed with visual analytics software can allow stakeholders to interact with statements on the environmental management strategies by performing diverse actions that promote learning. These actions include annotating, comparing, filtering, navigating, selecting and sharing relevant statements. We expect that the possibility of these multiple actions in an interactive manner help stakeholders to learn more effectively about the environmental strategies at U.S. DOE sites. The current case study for the project is a collection of 1,894 annotated (value-added) statements (sentence text) from the eight chapters of the 2017 Savanah River Site (SRS) annual site environmental report. The preliminary interactive visualizations are available online. (authors)

54 ENVIRONMENTAL SCIENCES↗