Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “stakeholder”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Making a Water Data System Responsive to Information Needs of Decision Makers

Evidence-based environmental management requires data that are sufficient, accessible, useful and used. A mismatch between data, data systems, and data needs for decision making can result in inefficient and inequitable capital investments, resource allocations, environmental protection, hazard mitigation, and quality of life. In this paper, we examine the relationship between data and decision making in environmental management, with a focus on water management. We focus on the concept of decision-driven data systems —data systems that incorporate an assessment of decision-makers' data needs into their design. The aim of the research was to examine the process of translating data into effective decision making by engaging stakeholders in the development of a water data system. Using California's legislative mandate for state agencies to integrate existing water and other environmental data as a case study, we developed and applied a participatory approach to inform data-system design and identify unmet data needs. Using workshops and focused stakeholder meetings, we developed 20 diverse use cases to assess data sources, availability, characteristics, gaps, and other attributes of data used for representative decisions. Federal and state agencies made up about 90% of the data sources, and could readily adapt to a federated data system, our recommended model for the state. The remaining 10% of more-specialized data, central to important decisions across multiple use cases, would require additional investment or incentives to achieve data consistency, interoperability, and compatibility with a federated system. Based on this assessment, we propose a typology of different types of data limitations and gaps described by stakeholders. We also propose technical, governance, and stakeholder engagement evaluation criteria to guide planning and building environmental data systems. Data-system governance involving both producers and users of data was seen as essential to achieving workable standards, stable funding, convenient data availability, resilience to institutional change, and long-term buy-in by stakeholders. Our work provides a replicable lesson for using decision-maker and stakeholder engagement to shape the design of an environmental data system, and inform a technical design that addresses both user and producer needs.

Cantor, Alida↗

How ExMC Communicates a System Model to Non-Modelers

NASA’s Human Research Program (HRP) Exploration Medical Capability (ExMC) Element adopted Systems Engineering (SE) principles and Model Based Systems Engineering (MBSE) tools to capture the system functions, system architecture, requirements, interfaces, and clinical capabilities for a future exploration medical system. There are many different stakeholders who may use the information in the model: systems engineers, clinicians (physicians, nurses, and pharmacists), scientists, and mission planners. Many of these stakeholders have neither access to MBSE modeling tools nor experience with SE modeling techniques. The challenge faced by ExMC SE team was how to present the content in the model to non-modelers in a way they would understand the content with limited training in MBSE and without using the modeling tool. ExMC SE team created a Hypertext Markup Language (HTML) report that shows key model content and is accessible to anyone with a browser. When creating the HTML report, the ExMC SE received stakeholder feedback on what content they wanted and how to display this content. Incorporating this feedback, the report arranges the content in a way that directs readers through the SE process taken to derive the requirements and helps them to understand the fundamental steps in an SE approach. The report includes links to source information (e.g., NASA documentation that describes levels of care) and other SE products (e.g., Concept of Operations). These links were provided to aid in the understanding of how the team created this content through a methodical SE approach. This presentation outlines the process used to develop the model, the data chosen to share with stakeholders, many of the model elements used in the report, the review process stakeholders followed, the comments received from the stakeholders, and the lessons ExMC learned through producing this HTML report.

J. Cohen↗

UAM Vision Concept of Operations (ConOps) UAM Maturity Level (UML) 4

This Vision ConOps is intended as a foundation to engage members of the UAM community and provide a consensus on the future vision of UAM operations. It provides a concept for more detailed discussion and a basis for the exploration of ideas using a common framework to inform the continued development and integration of UAM as part of the broader transportation system. Advanced Air Mobility (AAM) encompasses a range of innovative aviation technologies (small drones, electric aircraft, automated air traffic management, etc.) that are transforming aviation’s role in everyday life, including the movement of goods and people. Urban Air Mobility (UAM) represents one of the most exciting and complex AAM concepts with highly automated aircraft, providing commercial services to the public over densely populated cities. This concept has generated tremendous interest and industry investment. UAM envisages a future in which advanced technologies and new operational procedures enable practical, cost-effective air travel as an integral mode of transportation in metropolitan areas. It represents one of the most exciting and complex AAM concepts with highly automated aircraft providing commercial services to the public over densely populated cities. For this reason, the National Aeronautics and Space Administration (NASA) selected UAM as the initial goal of its AAM efforts and the focus of this Vision Concept of Operations (ConOps) document. UAM Community Vision ConOps: This Vision ConOps effort was led by experts from NASA’s Aeronautics Research Mission Directorate (ARMD) in collaboration with the Federal Aviation Administration (FAA) and Deloitte’s Ecosystem Advisory Group (a cohort of advisers with aviation, aerospace, and regulatory expertise). To develop this Vision ConOps, NASA, FAA, and Deloitte built upon the current body of aeronautical research and consulted with more than 100 stakeholder organizations. This UAM community includes entities ranging from legacy aviation leaders to innovators and new market entrants. Stakeholders consulted included the federal government, state and local government, aerospace original equipment manufacturers (OEMs), local transportation organizations, prospective UAM operators, academia, industry standards-setting bodies, airports, service suppliers, and others (as described in Appendix G). This input was captured through the following methods: • A series of more than two dozen interviews with industry experts, federal regulators, state and local governments, and industry trade groups provided insight into the challenges of UAM integration into the National Airspace System (NAS), as well as technology developments and a variety of perspectives as to how UAM systems will integrate. • A series of two-day community workshops enabling active, detailed engagement of nearly 100 industry, academic, federal, and state stakeholder individuals. These workshops, hosted by NASA and Deloitte, explored UAM concepts in detail, and stakeholders were invited to collaboratively analyze and propose solutions to some of the greatest conceptual challenges behind UAM at an intermediate state. • A review of more than 160 sources of UAM literature from across government, industry, and academia, which are listed in Appendix H. • The public sharing of workshop input and document drafts for review and input across the UAM community. Feedback in the form of more than 1,000 comments and inputs on the document was received from industry groups, individual companies, academia, and government (federal, state, and local), among others. Although effort was made to incorporate inputs from across the UAM stakeholder group, not all comments could ultimately be incorporated in this version. The team resolved conflicting comments or ideas while maintaining consistency with the known direction of regulators and ensuring the document was coherent and consistent. It is recognized that this is a rapidly evolving area and that concepts will likely change over time; as such, this Vision ConOps is a living document and is expected to evolve as concepts mature. The ConOps does, however, provide a vision of UAM concepts and solutions based on the broad insights from across the UAM stakeholder community at the time of its publication and is intended to serve as a UAM North Star for continued research and development of UAM. As a broad Vision ConOps, is not a detailed engineering document; rather, it focuses primarily on outlining a broad, high-level vision across all aspects of a UAM transportation system.

Urban Air Mobility↗

Identifying and Closing Medical Capability Gaps for Human Spaceflight Missions Beyond Low Earth Orbit

BACKGROUND: Features of human space missions beyond low Earth orbit such as increasing distance from Earth, lack of real-time communication, and limited or no evacuation or resupply capability are expected to drive an increase in medical risk and require crews to operate in an increasingly autonomous fashion. A diverse set of stakeholders at NASA are seeking to fund the development of concepts of operations, medical requirements, and medical capabilities for such missions. However, a systematic approach to identification of current medical capability gaps and a strategic framework to gap closure is needed. OVERVIEW: The Exploration Medical Integrated Product Team (XMIPT) has developed a list of nine high-level medical capability gaps and associated activities required for gap closure. The list was derived based on inputs from subject matter experts at NASA including flight surgeons, other clinical providers, as well as operational and research communities regarding medical capabilities required to support human missions to the Moon and the Mars surface. Responses were reviewed and distilled to identify common themes across capabilities. To ensure alignment with established human system risks, the gap list was further refined based on inputs from NASA’s Human System Risk Board. Relevant medical gap closure activities outside of those funded by the XMIPT were identified through solicitation of inputs from Elements of NASA’s Human Research Program (particularly Exploration Medical Capability), the broader medical operations community, and other stakeholders. This medical capability gap list is reviewed and updated regularly as new information becomes available or new stakeholders are identified. DISCUSSION: The medical capability gap list has matured to include a large group of NASA stakeholders and development activities. This has enabled articulation of priorities to funding entities and programmatic stakeholders, while serving as an accessible resource summarizing gap closure activities, relevant programmatic infusion points, and opportunities for collaboration between stakeholders. This presentation will provide an overview of the nine NASA medical capability gaps and their associated gap closure activities.

Moriah Thompson↗

Societal-Equity-Enhancing Criteria and Facility-Host Incentives Supporting Five Key Elements in the January 2012 Blue Ribbon Commission Report - 13015

In February 2009, the Obama Administration announced it would abandon USA's only candidate SNF/HLW-disposal facility since 1987. In 2010, all related activities were stopped and the Blue Ribbon Commission on America's Nuclear Future was established 'to recommend a new strategy for managing the back end of the nuclear fuel cycle', which it did in January 2012, emphasizing eight key elements. However, Key Element 1, 'A new, consent-based approach to siting future nuclear facilities', is qualitative/indeterminate rather than quantitative/measurable. It is thus highly-susceptible to semantic permutations that could extend rather than, as intended, expedite the siting of future nuclear facilities unless it also defines: a) Whose consent is needed?; and b) What constitutes consent? The following 'generic', radiation-risk- and societal-equity-based criteria address these questions: 1. Identify areas affected by projected radiation and other health risks from: a. The proposed nuclear facility (facility stakeholders); and b. The related nuclear-materials-transportation routes (transportation stakeholders); then 2. Surround each stakeholder area with a buffer zone and use this enlarged foot print to identify: a. Stakeholder hosts; and b. Areas not hosting any stakeholder category (interested parties). 3. Define 'consent-based' as being at least 60 percent of the 'population' in the respective stakeholder category and apply this yardstick to both 'in favor' and 'against' votes. Although criteria 1 and 2 also need facility-based definitions to make Key Element 1 measurable, the described siting approach, augmented by related facility-host incentives, would expedite the schedule and reduce the cost for achieving Key Elements 4-6 and 8, politics permitting. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Literature Review and Compilation of Nuclear Waste Management System Attributes for Use in Multi-Objective System Evaluations - 16618

The purpose of this work was to compile a comprehensive initial set of potential nuclear waste management system attributes. This initial set of attributes is intended to serve as a starting point for additional consideration by system analysts and planners to facilitate the development of a waste management system multi-objective evaluation framework based on the principles and methodology of multi-attribute utility analysis. The compilation is primarily based on a review of reports issued by the Canadian Nuclear Waste Management Organization (NWMO) and the Blue Ribbon Commission on America's Nuclear Future (BRC), but also an extensive review of the available literature for similar and past efforts as well. Numerous system attributes found in different sources were combined into a single objectives-oriented hierarchical structure. This study provides a discussion of the data sources and the descriptions of the hierarchical structure. A particular focus of this study was on collecting and compiling inputs from past studies that involved the participation of various external stakeholders. However, while the important role of stakeholder input in a country's waste management decision process is recognized in the referenced sources, there are only a limited number of in-depth studies of the stakeholders' differing perspectives. Compiling a comprehensive hierarchical listing of attributes is a complex task since stakeholders have multiple and often conflicting interests. The BRC worked for two years (January 2010 to January 2012) to 'ensure it has heard from as many points of view as possible'. The Canadian NWMO study took four years and ample resources, involving national and regional stakeholders' dialogs, internet-based dialogs, information and discussion sessions, open houses, workshops, round-tables, public attitude research, web site, and topic reports. The current compilation effort benefited from the distillation of these many varied inputs conducted by the previous studies. The initial set of attributes is intended to provide a starting point for considering potential objectives for evaluating nuclear waste management system options. It is envisioned that this initial set will evolve and be revised as new and additional input is received from stakeholders on various attributes and their relative importance. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The human dimensions of energy use in buildings: A review

The “human dimensions” of energy use in buildings refer to the energy-related behaviors of key stakeholders that affect energy use over the building life cycle. Stakeholders include building designers, operators, managers, engineers, occupants, industry, vendors, and policymakers, who directly or indirectly influence the acts of designing, constructing, living, operating, managing, and regulating the built environments, from individual building up to the urban scale. Among factors driving high-performance buildings, human dimensions play a role that is as significant as that of technological advances. However, this factor is not well understood, and, as a result, human dimensions are often ignored or simplified by stakeholders. This work presents a review of the literature on human dimensions of building energy use to assess the state-of-the-art in this topic area. The paper highlights research needs for fully integrating human dimensions into the building design and operation processes with the goal of reducing energy use in buildings while enhancing occupant comfort and productivity. This research focuses on identifying key needs for each stakeholder involved in a building's life cycle and takes an interdisciplinary focus that spans the fields of architecture and engineering design, sociology, data science, energy policy, codes, and standards to provide targeted insights. Greater understanding of the human dimensions of energy use has several potential benefits including reductions in operating cost for building owners; enhanced comfort conditions and productivity for building occupants; more effective building energy management and automation systems for building operators and energy managers; and the integration of more accurate control logic into the next generation of human-in-the-loop technologies. The review concludes by summarizing recommendations for policy makers and industry stakeholders for developing codes, standards, and technologies that can leverage the human dimensions of energy use to reliably predict and achieve energy use reductions in the residential and commercial buildings sectors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Spheres of public conversation: Experiences in strategic environmental assessment

This paper draws on earlier research, a national review of Scottish SEA practice and a survey of practitioners and stakeholders engaged in SEA and spatial planning in one Scottish city-region, to explore claims being made in the academic literature for Strategic Environmental Assessment (SEA) as a tool for deliberative plan-making. We consider whether there is evidence that Scottish SEA practice is helping create more inclusive plan-making processes in light of recent legislative changes, thereby fulfilling one of the expectations of Scottish Government. The macro analysis found that although there are opportunities for stakeholders to engage in the Scottish SEA process the level in practice is extremely low, a finding which mirrors experience in England and elsewhere. The more detailed micro analysis reveals a more nuanced picture within the spatial planning system, however, suggesting the existence of two distinct spheres of public conversations, one characterised by active dialogue about the environmental effects of alternative strategies amongst public sector stakeholders and the other involving non-governmental stakeholders and community groups in a much more limited way. The paper concludes with a discussion of possible explanations for this outcome, concerning asymmetric incentive structures and the application of power, and a consideration of the implications in relation to the competing discourses of SEA. -- Highlights: • We examine the extent to which Scottish SEA is helping promote inclusive plan-making. • Low levels of stakeholder engagement generally in Scottish SEA. • Stronger SEA dialogue amongst public agencies than with the wider community. • Importance of incentive structures and power capture in framing SEA public conversations.

54 ENVIRONMENTAL SCIENCES↗

Solid waste management challenges for cities in developing countries

Highlights: Black-Right-Pointing-Pointer Stakeholders. Black-Right-Pointing-Pointer Factors affecting performance waste management systems. Black-Right-Pointing-Pointer Questionnaire as Annex for waste management baseline assessment. - Abstract: Solid waste management is a challenge for the cities' authorities in developing countries mainly due to the increasing generation of waste, the burden posed on the municipal budget as a result of the high costs associated to its management, the lack of understanding over a diversity of factors that affect the different stages of waste management and linkages necessary to enable the entire handling system functioning. An analysis of literature on the work done and reported mainly in publications from 2005 to 2011, related to waste management in developing countries, showed that few articles give quantitative information. The analysis was conducted in two of the major scientific journals, Waste Management Journal and Waste Management and Research. The objective of this research was to determine the stakeholders' action/behavior that have a role in the waste management process and to analyze influential factors on the system, in more than thirty urban areas in 22 developing countries in 4 continents. A combination of methods was used in this study in order to assess the stakeholders and the factors influencing the performance of waste management in the cities. Data was collected from scientific literature, existing data bases, observations made during visits to urban areas, structured interviews with relevant professionals, exercises provided to participants in workshops and a questionnaire applied to stakeholders. Descriptive and inferential statistic methods were used to draw conclusions. The outcomes of the research are a comprehensive list of stakeholders that are relevant in the waste management systems and a set of factors that reveal the most important causes for the systems' failure. The information provided is very useful when planning, changing or implementing waste management systems in cities.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative Universal Option Prioritizer (QUOP) v1.0.0

Quantitative Universal Option Prioritizer (QUOP) is a three-layer analytical hierarchy process (AHP) based multi-criteria decision-making option evaluation and prioritization tool. Decision-making often entails evaluation of options. Such competing options can either be mutual substitutes or cumulative means to achieve an objective. The options themselves can be methods, tools, technologies, processes, etc. Stakeholders involved in achieving the objective may view each option characteristic differently, depending on their needs and preferences. The QUOP tool enables a streamlined quantitative collaborative process of weighing the opinion of each stakeholder in evaluating the options. The evaluation may also be performed under different scenarios, for instance, various option potential estimates, prices, or end-user demand projections. The QUOP tool can find application in both public and private sectors, as well as on an individual level. The major advantage of using the QUOP decision-making tool is in documenting the quantified stakeholder opinion, therefore the background to each decision made, while simultaneously maintaining high transparency and stakeholder involvement. The tool is particularly suitable for decisions involving a high number of options and option characteristics, that is, aspects of each option that matter to the stakeholders

Grahovac, Milica↗

cabbi-bio/BECT-ABM

The emergence of the cellulosic bioeconomy requires not only adequate technological, economic, and policy advances, but also effective communication and coordination among the multiple stakeholders in the bioeconomy community. Aiming to facilitate stakeholder communication and collaboration for cellulosic bioeconomy growth, an agent-based model is developed as a community communication tool in this study. The tool simulates the behaviors and interactions of key stakeholders, as well as the responses and interactions between the stakeholders and biophysical, socioeconomic, and environmental conditions. The agent behavior rules are developed and validated based on behavior and economic theories and information attained from a stakeholder focus group study and a land use survey.

Yang, Pan↗

Deployment Effects of Marin Renewable Energy Technologies

Given proper care in siting, design, deployment, operation and maintenance, marine and hydrokinetic technologies could become one of the more environmentally benign sources of electricity generation. In order to accelerate the adoption of these emerging hydrokinetic and marine energy technologies, navigational and environmental concerns must be identified and addressed. All developing hydrokinetic projects involve a wide variety of stakeholders. One of the key issues that site developers face as they engage with this range of stakeholders is that many of the possible conflicts (e.g., shipping and fishing) and environmental issues are not well-understood, due to a lack of technical certainty. In September 2008, re vision consulting, LLC was selected by the Department of Energy (DoE) to apply a scenario-based approach to the emerging wave and tidal technology sectors in order to evaluate the impact of these technologies on the marine environment and potentially conflicting uses. The project’s scope of work includes the establishment of baseline scenarios for wave and tidal power conversion at potential future deployment sites. The scenarios will capture variations in technical approaches and deployment scales to properly identify and characterize environmental impacts and navigational effects. The goal of the project is to provide all stakeholders with an improved understanding of the potential effects of these emerging technologies and focus all stakeholders onto the critical issues that need to be addressed. This groundwork will also help in streamlining siting and associated permitting processes, which are considered key hurdles for the industry’s development in the U.S. today. Re vision is coordinating its efforts with two other project teams funded by DoE which are focused on regulatory and navigational issues. The results of this study are structured into three reports: 1. Wave power scenario description 2. Tidal power scenario description 3. Framework for Identifying Key Environmental Concerns This is the second report in the sequence and describes the results of conceptual feasibility studies of tidal power plants deployed in Tacoma Narrows, Washington. The Narrows contain many of the same competing stakeholder interactions identified at other tidal power sites and serves as a representative case study. Tidal power remains at an early stage of development. As such, a wide range of different technologies are being pursued by different manufacturers. In order to properly characterize impacts, it is useful to characterize the range of technologies that could be deployed at the site of interest. An industry survey informs the process of selecting representative tidal power devices. The selection criteria is that such devices are at an advanced stage of development to reduce technical uncertainties and that enough data are available from the manufacturers to inform the conceptual design process of this study. Further, an attempt is made to cover the range of different technologies under development to capture variations in potential environmental effects. A number of other developers are also at an advanced stage of development including Verdant Power, which has demonstrated an array of turbines in the East River of New York, Clean Current, which has demonstrated a device off Race Rocks, BC, and OpenHydro, which has demonstrated a device at the European Marine Energy Test Center and is on the verge of deploying a larger device in the Bay of Fundy. MCT demonstrated their device both at Devon (UK) and Strangford Narrows (Northern Ireland). Furthermore OpenHydro, CleanCurrent, and MCT are the three devices being installed at the Minas Passage (Canada). Environmental effects will largely scale with the size of tidal power development. In many cases, the effects of a single device may not be measurable, while larger scale device arrays may have cumulative impacts that differ significantly from smaller scale deployments. In order to characterize these effects, scenarios are established at three deployment scales which nominally represent (1) a small pilot deployment, (2) an early, small commercial deployment, and (3) a large commercial scale plant. For the three technologies and scales at the selected site, this results in a total of nine deployment scenarios outlined in the report.

16 TIDAL AND WAVE POWER↗

Deployment Effects of Marine Renewable Energy Technologies: Wave Energy Scenarios

Given proper care in siting, design, deployment, operation and maintenance, wave energy conversion could become one of the more environmentally benign sources of electricity generation. In order to accelerate the adoption of these emerging hydrokinetic and marine energy technologies, navigational and environmental concerns must be identified and addressed. All developing hydrokinetic projects involve a wide variety of stakeholders. One of the key issues that site developers face as they engage with this range of stakeholders is that, due to a lack of technical certainty, many of the possible conflicts (e.g., shipping and fishing) and environmental issues are not well-understood,. In September 2008, re vision consulting, LLC was selected by the Department of Energy (DoE) to apply a scenario-based assessment to the emerging hydrokinetic technology sector in order to evaluate the potential impact of these technologies on the marine environment and navigation constraints. The project’s scope of work includes the establishment of baseline scenarios for wave and tidal power conversion at potential future deployment sites. The scenarios capture variations in technical approaches and deployment scales to properly identify and characterize environmental effects and navigational effects. The goal of the project is to provide all stakeholders with an improved understanding of the potential range of technical attributes and potential effects of these emerging technologies and focus all stakeholders on the critical issues that need to be addressed. By identifying and addressing navigational and environmental concerns in the early stages of the industry’s development, serious mistakes that could potentially derail industry-wide development can be avoided. This groundwork will also help in streamlining siting and associated permitting processes, which are considered key hurdles for the industry’s development in the U.S. today. Re vision is coordinating its efforts with two other project teams funded by DoE which are focused on regulatory issues (Pacific Energy Ventures) and navigational issues (PCCI). The results of this study are structured into three reports: (1) Wave power scenario description (2) Tidal power scenario description (3) Framework for Identifying Key Environmental Concerns This is the first report in the sequence and describes the results of conceptual feasibility studies of wave power plants deployed in Humboldt County, California and Oahu, Hawaii. These two sites contain many of the same competing stakeholder interactions identified at other wave power sites in the U.S. and serve as representative case studies. Wave power remains at an early stage of development. As such, a wide range of different technologies are being pursued by different manufacturers. In order to properly characterize potential effects, it is useful to characterize the range of technologies that could be deployed at the site of interest. An industry survey informed the process of selecting representative wave power devices. The selection criteria requires that devices are at an advanced stage of development to reduce technical uncertainties, and that enough data are available from the manufacturers to inform the conceptual design process of this study. Further, an attempt is made to cover the range of different technologies under development to capture variations in potential environmental effects. Table 1 summarizes the selected wave power technologies. A number of other developers are also at an advanced stage of development, but are not directly mentioned here. Many environmental effects will largely scale with the size of the wave power plant. In many cases, the effects of a single device may not be measurable, while larger scale device arrays may have cumulative impacts that differ significantly from smaller scale deployments. In order to characterize these effects, scenarios are established at three deployment scales which nominally represent (1) a small pilot deployment, (2) a small commercial deployment, and (3) a large commercial scale plant. It is important to understand that the purpose of this study was to establish baseline scenarios based on basic device data that was provided to use by the manufacturer for illustrative purposes only.

16 TIDAL AND WAVE POWER↗

Solar America Initiative State Working Group (Final Scientific/Technical Report)

Through the support from the Department of Energy, NARUC has educated thousands of stakeholders, including Public Utility Commissioners, commission staff, and State energy officials on solar energy technology, implementation, and policy. During the lifetime of this grant, NARUC staff engaged stakeholders in policy discussions, technical research, site visits, and educational meetings/webinars/materials that provided valuable education and coordination on solar energy technology and policy among the States. Primary research geared toward State decision-makers enabled stakeholders to be informed on current issues and created new solar energy leaders throughout the United States. Publications including a Frequently Asked Questions guide on feed-in tariffs and a legal analysis of state implementation of feed-in tariffs gave NARUC members the capacity to understand complex issues related to the economic impacts of policies supportive of solar energy, and potential paths for implementation of technology. Technical partnerships with the National Renewable Energy Laboratory (NREL) instructed NARUC members on feed-in tariff policy for four States and solar PV resource assessment in seven States, as well as economic impacts of solar energy implementation in those States. Because many of the States in these technical partnerships had negligible amounts of solar energy installed, this research gave them new capacity to understand how policies and implementation could impact their constituency. This original research produced new data now available, not only to decision-makers, but also to the public at-large including educational institutions, NGOs, consumer groups, and other citizens who have an interest in solar energy adoption in the US. Under this grant, stakeholders engaged in several dialogs. These educational opportunities brought NARUC members and other stakeholders together several times each year, shared best practices with State decision-makers, fostered partnerships and relationships with solar energy experts, and aided in increasing the implementation of smart policies that will foster solar technology deployment. The support from the Department of Energy's Office of Energy Efficiency and Renewable Energy has created solar energy leaders in the States; leaders who will serve to be a continuing valuable resource as States consider adoption of new low-carbon and domestic energy supply to meet the energy needs of the United States.

14 SOLAR ENERGY↗

Development and implementation of energy efficiency standards and labeling programs in China: Progress and challenges

Over the last twenty years, with growing policy emphasis on improving energy efficiency and reducing environmental pollution and carbon emissions, China has implemented a series of new minimum energy performance standards (MEPS) and mandatory and voluntary energy labels to improve appliance energy efficiency. As China begins planning for the next phase of standards and labeling (S&L) program development under the 12th Five Year Plan, an evaluation of recent program developments and future directions is needed to identify gaps that still exist when compared with international best practices. The review of China’s S&L program development and implementation in comparison with major findings from international experiences reveal that there are still areas of improvement, particularly when compared to success factors observed across leading international S&L program. China currently lacks a formalized regulatory process for standard-setting and do not have any legal or regulatory guidance on elements of S&L development such as stakeholder participation or the issue of legal precedence between conflicting national, industrial and local standards. Consequently, China’s laws regarding standard-setting and management of the mandatory energy label program could be updated, as they have not been amended or revised recently and no longer reflects the current situation. While China uses similar principles for choosing target products as the U.S., Australia, EU and Japan, including high energy-consumption, mature industry and testing procedure and stakeholder support, recent MEPS revisions have generally aimed at only eliminating the bottom 20% efficiency of the market. Setting a firm principle based on maximizing energy savings that are technically feasible and economically justified may help improve the stringency of China’s MEPS program and reduce the need for frequent revisions. China also lacks robust survey data and relies primarily on market research data in relatively simple techno-economic analyses used to determine its efficiency standards levels rather than the specific sets of analyses and tools used internationally. Based on international experiences, inclusion of more detailed energy consumption surveys in the Chinese national census surveys and statistical reporting systems could help provide the necessary data for more comprehensive standard-setting analyses. In terms of stakeholder participation in the standards development process, stakeholder participation in China is limited to membership on technical committees responsible for developing or revising standards and generally do not include environmental groups, consumer associations, utilities and other NGOs. Increasing stakeholder involvement to broader interest groups could help garner more support and feedback in the S&L implementation process. China has emerged as a leader in a national verification testing scheme with complementary pilot checktesting projects, but it still faces challenges with insufficient funding, low local awareness amongst some regulatory agencies and resistance to check-testing by some manufacturers, limited product sampling scope, and testing inconsistency and incomparability of results. Thus, further financial and staff resources and capacity building will be needed to overcome these remaining challenges and to expand impacts evaluations to assess the actual effectiveness of implementation and enforcement.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A New Appraisal- Lessons from the History of Efforts to Value Green and High-Performance Home Attributes in the United States

Rigorous consideration of green and high-performance (“green/HP”) features is rarely included in the property valuation process._ To help illuminate why this is the case, this report takes stock of the history of efforts to improve practices, and identifies barriers that have emerged and opportunities for overcoming them. Particular emphasis is placed on what energy and environmental policymakers and other stakeholders outside the appraisal community can contribute to the broader effort to advance professional practices. The history has unfolded in parallel with turbulent periods in the housing market for which appraisers and their customers are deemed to share responsibility, followed by cycles of regulations, siloing of appraisers in the name of professional integrity, and commoditization of the valuation process itself. This pattern has important ramifications for aspirations that appraisers engage more fully in identifying and valuing the green/HP characteristics of homes. On the one hand, it is legally and ethically incumbent on appraisers to do so, yet on the other hand it is perceived as a risky avenue to follow. Risks arise where findings can be challenged as either over- or under-stating value, together with a market environment in which the complexity of their assignments increases despite downward pressure on appraiser fees. While efforts to address green/HP considerations date back to the early 1980s, the vast majority of activity has taken place within the past five years. Many players have engaged in the efforts to promote improved valuation practices. These include the Appraisal Foundation, The Appraisal Institute, Colorado Energy Office, Earth Advantage, EcoBroker, Elevate Energy, Fannie Mae, Federal Housing Administration, Home Innovation Research Labs, The Institute for Market Transformation, Northwest Energy Efficiency Alliance, National Association of Homebuilders, National Association of State Energy Officials, National Association of Appraisers, RESNET, USEPA, USDOE and its National Laboratories, the U.S. Green Buildings Council, and the Vermont Green Homes Alliance. Many activities have resulted, ranging from trainings, to data-gathering instruments, and the emergence of a literature attempting to statistically isolate the effects of green/HP characteristics on home values. In some cases, the results of studies have been overgeneralized and oversold, and embodied flawed methods. Although the green/HP community has encouraged appraisers to focus on exemplary buildings (e.g., LEED or ENERGY STAR Certified), any level of green or energy performance can in fact influence value, including below-average performance (a.k.a. “brown discount”), irrespective of whether or not the building has been formally rated. This overly narrow focus represents a significant missed opportunity. Other surmountable challenges include limitations to non-appraisers’ understanding of the appraisal process (and practical constraints therein). A byproduct of this can be unrealistic expectations of what appraisers can and will do in the marketplace. These challenges notwithstanding, the environment for moving forward has improved. There is better data today (a critical need); expanded efforts to disclose energy use information (characteristics, consumption, bills); improved and more pervasive building energy codes, building rating and labeling initiatives; and a host of federal, state, and local policies that have collectively brought green/HP practices much more into the mainstream. Meanwhile, a renewed focus on professional standards of care and competency for assessing green/HP homes make it increasingly important for appraisers to consider these factors in their assignments. Despite the past four decades of studies, there is little if any discernible uptake of these practices by the appraisal practice at large. It would behoove interested parties to step back and consider what new strategies might be productive. A key element of any new plan should be to reset the nature of interactions with the industry, with the goal a more collaborative, two-way discussion to help improve outsiders’ understanding of the valuation process. It is not only the appraiser that needs to be engaged and could benefit from awareness raising. Homeowners, builders, lenders, utilities, insurance companies should also provide input on how green/HP factors impact property valuations and ways to accurately reflect these considerations in appraisals and real estate transactions more broadly. Given extensive inertia within the appraisal industry and a mixed history of interactions with the non-appraisal stakeholders, it is unlikely that the status quo will achieve much unless followed with more coordinated and persistent efforts. Workshops, studies, and memoranda of understanding will not on their own have much impact, and do not address deeper structural issues. Expectations are often unrealistic and not attentive to real-world constraints faced by appraisers. The report identifies key barriers impeding more thorough consideration of green/HP factors in residential real estate appraisals, and solutions for mitigating them. Barriers • Although industry standards of practice caution against bias of any sort, a skeptical predisposition towards “green” is reinforced by information deficiencies. • Information deficiencies result from the lack or difficulty of obtaining usable data on green/HP features in subject properties as well as valid sales comparisons or cashflow analyses. • Competency deficiencies, such as lack of conversancy in relevant technical topics, leads to oversights, and disjointed treatment of relevant information. • Time/cost pressure and process commoditization (e.g., template-based approaches) result from highly constrained budgets, quick turn-around times expected of appraisers, and standardized practices that were not developed with green/HP considerations in mind. • Professional differences between appraisers and sustainability professionals include divergent objectives, the former being market observers and the latter market influencers. • Risk aversion arises from multiple concerns including veracity, accuracy, and persistence of energy data, impacts of operational choices, new sources of appraiser liability associated with green/HP assessments, industry pressures not to over-value buildings or suggestion of bias, and concern about spending non-billable time on complex assignments. • A public policy vacuum has been created by disjointed and uncoordinated efforts from public-sector stakeholders, insufficient efforts to discuss and understand the appraisal industry and process, and a perception by some valuation professionals that green/HP is oversold. Opportunities • Elevating the competency of appraisers can be achieved through a combination of improved industry standards of care and equal-access training and professional development offerings. • Development of better information resources must focus on building-level information that provides robust documentation as well as aggregate sales-comparison data and other contextual information such as local codes, typical upgrade costs, energy prices, etc. • Improved energy benchmarking and rating tools could provide appraisers with information more well-adapted to their particular needs, which differ from those of typical audiences such as energy managers. • Better characterizing and managing risk will enable appraisers to cope with uncertainties in performance information, and help identify where risks may be introduced or mitigated by green/HP features, including higher costs or obsolescence of poorly-performing buildings. • Integrating disaster resilience and sustainability in appraisals would recognize important synergisms among these features, including durability and ability of green/HP buildings to better withstand external hazards. • Mitigating the problem of additional time/cost for performing assignments is an essential need that can be addressed by providing easier access to information and analytic procedures, perhaps coupled with new resources to defray the associated costs. • Enhancing demand for improved appraisals is a fundamental need, and depends on owners, developers, lenders, and others soliciting competent appraisers to perform scopes that expressly call out green/HP considerations, and to critically review the work product for compliance before acceptance. • Engaging new market participants, such as energy utilities and insurance companies can ensure fuller representation and participation of market stakeholders already engaged in green/HP activities and capable of furnishing valuable data and managing associated risks. Cutting across these individual activities, there is a need for outside stakeholders to formulate and follow a roadmap instead of piecemeal initiatives, bridging the professional/cultural divide between appraisers and green/HP communities, and tracking progress in order to know what is working. A more coherent communication and training strategy is needed, as the appraisal industry is highly fragmented, with two-thirds of appraisers opting out of membership in trade associations. In sum, while there is no silver bullet for advancing the practice of valuing green/HP features, there are concrete opportunities. Parties seeking solutions must identify barriers they wish to address and select from among potential initiatives that map to those barriers. Close collaboration with the appraisal community is critical, as non-appraisers have historically obtained limited traction with this industry due to lack of understanding of the nuances involved in the valuation profession. Large organizations and agencies should have a united approach; the perception or reality of a fragmented and uncoordinated strategy is unsettling for prospective partners in the appraisal industry. This requires improved communication and education within and among these communities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The Status and Promise of Advanced M&V: An Overview of “M&V 2.0” Methods, Tools, and Applications

Advanced measurement and verification (M&V) of energy efficiency savings, often referred to as M&V 2.0 or advanced M&V, is currently an object of much industry attention. Thus far, however, there has been a lack of clarity about what techniques M&V 2.0 includes, how those techniques differ from traditional approaches, what the key considerations are for their use, and what value propositions M&V 2.0 presents to different stakeholders. The objective of this paper is to provide background information and frame key discussion points related to advanced M&V. The paper identifies the benefits, methods, and requirements of advanced M&V and outlines key technical issues for applying these methods. It presents an overview of the distinguishing elements of M&V 2.0 tools and of how the industry is addressing needs for tool testing, consistency, and standardization, and it identifies opportunities for collaboration. In this paper, we consider two key features of M&V 2.0: (1) automated analytics that can provide ongoing, near-real-time savings estimates, and (2) increased data granularity in terms of frequency, volume, or end-use detail. Greater data granularity for large numbers of customers, such as that derived from comprehensive implementation of advanced metering infrastructure (AMI) systems, leads to very large data volumes. This drives interest in automated processing systems. It is worth noting, however, that automated processing can provide value even when applied to less granular data, such as monthly consumption data series. Likewise, more granular data, such as interval or end-use data, delivers value with or without automated processing, provided the processing is manageable. But it is the combination of greater data detail with automated processing that offers the greatest opportunity for value. Using M&V methods that capture load shapes together with automated processing1 can determine savings in near-real time to provide stakeholders with more timely and detailed information. This information can be used to inform ongoing building operations, provide early input on energy efficiency program design, or assess the impact of efficiency by location and time of day. Stakeholders who can make use of such information include regulators, energy efficiency program administrators, program evaluators, contractors and aggregators, building owners, the investment community, and grid planners. Although each stakeholder has its own priorities and challenges related to savings measurement and verification, the potential exists for all to draw from a single set of efficiency valuation data. Such an integrated approach could provide a base consistency across stakeholder uses.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Precision Local Positioning System

The primary goal of the project is to lay the groundwork for a new system design, meaning that at the end of this project’s effort, a traditional LLNL project could begin. For this goal to be met, the overarching needs of potential sponsors and stakeholders must be analyzed and understood, and a clear statement of work should be able to be drafted from the finding in this report. More specifically, the results from this project should immediately feed into the drafting of requirements, an implementation plan, and a budget plan for a future project. In order to accomplish this goal, the team set a broad framework for work to be completed. First, conduct current market research and select reference technologies to decompose. From the decompositions, analyze shortcomings, possible pain-points and form metrics and architectural decisions. Next, analyze the potential market area by interviewing/researching stakeholders and understanding their needs. As an additional project goal, attempt to capture as large a market area and scope as reasonably possible by incorporating more than the traditional LLNL sponsors. From the information gathered, study stakeholder salience and understand the relationships between stakeholders, mission areas, mission critical functions, and system metrics. Further analyze the relationships to focus on critical system aspects and to group stakeholders and mission together in order to reduce system complexity while maintaining wide marketability. Finally, begin brainstorming concepts from the established architectural decision and use the found metrics to create tradespaces to down select the most viable architectures. This document presents the team’s findings as it progressed through the project’s strategy.

42 ENGINEERING↗