Talk to Me: A Case Study on Coordinating Expertise in Large-Scale Scientific Software Projects.
Abstract not provided.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Abstract not provided.
Emerging aviation markets such as urban air mobility are giving rise to new technologies and means of operation. However, novelty may hide ‘unknown unknowns,’ raising new hazards. This paper examines how expertise and safety techniques enable transformative technologies such as reduced crew operations, hybrid wing-borne and rotor-born flight, federated air traffic services, and urban operations. We explore how analysts use expertise to address common-cause failures, collect and interpret safety data, and perform exacting tradeoffs between dissimilarity, redundancy, independence, and diversity (human, process lifecycle, or otherwise) to ensure safety. When novelty is present, analysts might not possess the expertise needed to fully understand the implications of design decisions and tradeoffs being made, especially in early lifecycle phases, on emergent properties such as safety. Safety expertise must be carefully cultivated. The conflicting views of safety experts must be unpacked to identify the divergence in fundamental assumptions, models, means, and methods that may be causing them. Once systems venture beyond the basis of what safety expertise can reliably guarantee, projects take on risk that must be managed. The paper contains key takeaways and actionable recommendations for novel OEMs and regulators touching on topics such as robust monitoring; clear and transparent reporting; incremental approaches to fielding novel systems in hazard-rich, risk-tolerant environments; the cultivation of safety culture and expertise in an organization; and the use of scientific study to reduce epistemic uncertainty in novel operations with new technologies. Since excessive novelty in aviation can undermine the current foundation of safety, humility and incrementalism are necessary to enable emerging aviation markets safely.
Emerging aviation markets such as urban air mobility are giving rise to new technologies and means of operation. However, novelty may hide ‘unknown unknowns,’ raising new hazards. This paper examines how expertise and safety techniques enable transformative technologies such as reduced crew operations, hybrid wing-borne and rotor-born flight, federated air traffic services, and urban operations. We explore how analysts use expertise to address common-cause failures, collect and interpret safety data, and perform exacting tradeoffs between dissimilarity, redundancy, independence, and diversity (human, process lifecycle, or otherwise) to ensure safety. When novelty is present, analysts might not possess the expertise needed to fully understand the implications of design decisions and tradeoffs being made, especially in early lifecycle phases, on emergent properties such as safety. Safety expertise must be carefully cultivated. The conflicting views of safety experts must be unpacked to identify the divergence in fundamental assumptions, models, means, and methods that may be causing them. Once systems venture beyond the basis of what safety expertise can reliably guarantee, projects take on risk that must be managed. The paper contains key takeaways and actionable recommendations for novel OEMs and regulators touching on topics such as robust monitoring; clear and transparent reporting; incremental approaches to fielding novel systems in hazard-rich, risk-tolerant environments; the cultivation of safety culture and expertise in an organization; and the use of scientific study to reduce epistemic uncertainty in novel operations with new technologies. Since excessive novelty in aviation can undermine the current foundation of safety, humility and incrementalism are necessary to enable emerging aviation markets safely.
Astronaut training for ISS operations usually ensures independent performance. With small crew size same crews also conduct all science work onboard. With diverse backgrounds, a good "match" between the existing and required skills can only be anecdotal. Furthermore, full proficiency in most of the complex tasks can be attained only through long training and practice, which may not be justified and may be impossible given the scarcity of training time. To enable a number of operational and science advancements, authors have developed a new approach to expertise distribution in time and among the space and ground personnel. Methods: As part of NASA Operational Ultrasound Project (1998-2003) and the NASA-solicited experiment "Advanced Diagnostic Ultrasound in Microgravity-ADUM" (P.I. -S.D., ongoing), the authors have created a "Balanced Expertise Distribution" approach to perform complex ultrasound imaging tasks on ISS for both operational and science use. The four components of expertise are a) any pre-existing pertinent expertise; b) limited preflight training c) adaptive onboard proficiency enhancement tools; d) real-time ' guidance from the ground. Throughout the pre-flight training and flight time preceding the experiments, the four components are shaped in a dynamic fashion to meet in an optimum combination during the experiment sessions. Results: Procedure validation sessions and feasibility studies have given encouraging results. While several successful real-time remote guidance sessions have been conducted on ISS, Expedition 8 is the first to use an "on-orbit proficiency enhancement" tool. Conclusions: In spite of severely limited training time, daring peer-reviewed research and operational enhancements are feasible through a balanced distribution of expertise in time, as well as among the crewmembers and ground personnel. This approach shows great promise for biomedical research, but may be applicable for other areas of micro gravity-based science
Detecting and anticipating global proliferation expertise and capability evolution from unstructured, noisy, and incomplete public data streams is a highly desired, but extremely challenging task. Here, in this article, we present our pioneering data-driven approach to support the non-proliferation mission to detect and explain the evolution of proliferation expertise and capability development globally from terabytes of publicly available information (PAI), focusing on our knowledge extraction pipeline and descriptive analytics. We first discuss how we fuse nine open-source data streams, including multilingual data, to convert 4 TB of unstructured data to structured knowledge and encode dynamically evolving proliferation expertise representations—content and context graphs. For this, we rely on natural language processing (NLP) and deep learning (DL) models to perform information extraction, topic modeling, and distributed text representation (aka embedding) learning. We then present interactive, usable, and explainable descriptive analytics to refine domain knowledge and present it in a human-understandable form. Finally, we introduce future work avenues that will leverage our dynamic knowledge representations and descriptive analytics to enable predictive and prescriptive inferences to achieve real-time domain understanding and contextual reasoning about global proliferation expertise and capability evolution.
High-performance computing (HPC) is one area where the DOE has developed extensive expertise and capability. However, this expertise currently is not properly shared with or used by the private sector to speed product development, enable industry to move rapidly into new areas, and improve product quality. Such use would lead to substantial competitive advantages in global markets and yield important economic returns for the United States. To stimulate the dissemination of DOE's HPC expertise, the Council for Chemical Research (CCR) and the DOE jointly held a workshop on this topic. Four important energy topic areas were chosen as the focus of the meeting: Biomass/Bioenergy, Catalytic Materials, Energy Storage, and Photovoltaics. Academic, industrial, and government experts in these topic areas participated in the workshop to identify industry needs, evaluate the current state of expertise, offer proposed actions and strategies, and forecast the expected benefits of implementing those strategies.
Within a few years, JPL will be challenged by the most active mission set in history. Concurrently, flight systems are increasingly more complex. Presently, the knowledge to conduct integration and test of spacecraft and large instruments is held by a few key people, each with many years of experience. JPL is in danger of losing a significant amount of this critical expertise, through retirement, during a period when demand for this expertise is rapidly increasing. The most critical issue at hand is to collect and retain this expertise and develop tools that would ensure the ability to successfully perform the integration and test of future spacecraft and large instruments. The proposed solution was to capture and codity a subset of existing knowledge, and to utilize this captured expertise in knowledge-based systems. First year results and activities planned for the second year of this on-going effort are described. Topics discussed include lessons learned in knowledge acquisition and elicitation techniques, life-cycle paradigms, and rapid prototyping of a knowledge-based advisor (Spacecraft Test Assistant) and a hypermedia browser (Test Engineering Browser). The prototype Spacecraft Test Assistant supports a subset of integration and test activities for flight systems. Browser is a hypermedia tool that allows users easy perusal of spacecraft test topics. A knowledge acquisition tool called ConceptFinder which was developed to search through large volumes of data for related concepts is also described and is modified to semi-automate the process of creating hypertext links.
People are experts when it comes to the work they do; unfortunately their expertise is not utilized as frequently as it could be. More opportunities need to be provided that allow people to participate in the design of their work including: accident investigations, job planning, and process improvements. Many employers use some form of job hazard analysis process to identify and document hazards and controls, but the front line worker is rarely involved. This presentation will show the core principles supporting employee involvement, provide examples where workers had brilliant ideas but no one listened, and provide examples where workers were given the opportunity to use their expertise to improve occupational safety. According to Abraham Maslow's Hierarch of Needs model, one essential human need is to be innovative and solve problems. Advances in brain science have proven, through functional magnetic resonance imaging (fMRI) studies, the brain reward pathway is activated when people are recognized for their intellectual contributions. As people contribute their expertise to improve occupational safety more frequently they will feel a sense of gratification. In addition, safety professionals will have more time to spend on strategic planning of emerging occupational safety issues. One effect of the current global recession is that SH&E professionals are asked to do more with less. Therefore, to be successful it is essential that SH&E professionals incorporate worker expertise in job planning. This will be illustrated in the presentation through an example where a worker had the answer to a difficult decision on appropriate personal protective equipment for a job but no one asked the worker for his idea during the job planning phase. Fortunately the worker was eventually consulted and his recommendation for the appropriate personal protective equipment for the job was implemented before work began. The goal of this presentation is to expand the awareness and knowledge of SH&E professionals on the benefits and opportunities for leveraging brain science. This will include an overview of the components of the brain reward pathway and the biological mechanisms that make workers feel a sense of gratification when they contribute their ideas toward improving occupational safety. On-the-job examples where it is hypothesized that the brain reward pathway was activated in workers will be provided. Finally, the presentation will include a model illustrating the importance of empowering workers to participate in occupational safety programs. SH&E professionals can use this model to maintain a robust safety and health program with limited resources. The model will also help SH&E professionals prepare for challenges in the SH&E fields by showing them how to allocate more time for strategic planning of emerging issues. Many recent best selling business books such as Wikinomics, Crowdsourcing, and Sway, illustrate how the benefit of harnessing the collective knowledge of employees is a key to company success. Companies like Google and Pixar have mastered the ability to capture empFoyee knowledge in terms of technology. Why should occupational safety be any different? Workers know how to improve safety in their workplace. SH&E professionals can harness this collective safety knowledge just as top companies do with technology, and workers will feel grateful for contributing.
The ability to anticipate global technical expertise and capability evolution trends is essential for national and global security, especially in safety-critical domains such as nuclear nonproliferation (NN) and rapidly emerging fields like artificial intelligence (AI). Here, in this work, we extend traditional statistical relational learning approaches (e.g., link prediction in collaboration networks) and formulate a problem of anticipating technical expertise and capability evolution using dynamic heterogeneous graph representations. We develop novel capabilities to forecast collaboration patterns, authorship behavior, and technical capability evolution at different granularities (e.g., scientist and institution levels) in two distinct research fields. We implement a dynamic graph transformer (DGT) neural architecture, which pushes the state-of-the-art graph neural network models by: 1) forecasting heterogeneous (rather than homogeneous) nodes and edges; and 2) relying on both discrete- and continuous-time inputs. We demonstrate that our DGT models predict collaboration, partnership, and expertise patterns with 0.26, 0.73, and 0.53 mean reciprocal rank values for AI and 0.48, 0.93, and 0.22 for NN domains. DGT model performance exceeds the best-performing static graph baseline models by 30%–80% across AI and NN domains. Our findings demonstrate that DGT models boost inductive task performance when previously unseen nodes appear in the test data for the domains with emerging collaboration patterns (e.g., AI). Specifically, models accurately predict which established scientists will collaborate with early career scientists and vice versa in the AI domain.
This report examines the establishment and operation of Energy Performance Contracting (EPC) Centers of Expertise (COEs) within the federal government. EPCs, including Energy Savings Performance Contracts (ESPCs) and Utility Energy Service Contracts (UESCs), are critical mechanisms for advancing energy efficiency, resilience, and infrastructure modernization without the need for significant upfront appropriations. However, EPCs require specialized knowledge in project development, contracting, financing, legal parameters and technical project oversight. Currently federal agencies have varying levels of expertise and institutionalized policy to effectively and consistently use congressionally authorized EPCs which have decades of proven and impactful use. To address these challenges, several federal agencies have created COEs to centralize expertise, standardize practices, and streamline implementation. This report reviews statutory and policy drivers, highlights the benefits and challenges and presents case studies from the General Services Administration (GSA), the Department of Veterans Affairs (VA) and the U.S. Army Engineering and Support Center Huntsville (HNC). Recommendations are also provided for agencies considering the establishment of EPC COEs, which will bring much needed structure, consistency and lead to implementation of these energy and infrastructure building projects to save costs for U.S. taxpayers.
This report explored techniques to mine web pages of scientists to extract information regarding their expertise, build expertise chains and referral webs, and semi automatically combine this information with directory information services to create a recommender system that permits query by expertise. The approach included experimenting with existing techniques that have been reported in research literature in recent past , and adapted them as needed. In addition, software tools were developed to capture and use this information.
Teamwork can harness the collective energy of people to solve complex problems. Yet, teamwork requires more than just putting people together. Complexity is added when people from different organizations or areas of expertise form a team to accomplish specific ends. Every organization is designed to fulfill certain purposes and, as such, it has unique objectives and values and it operates according to methods, procedures, and norms intended to fulfill those objectives and values. And each field of expertise, with its specialized knowledge, uses certain methods to approach and solve problems. Teams that consist of people from multiple organizations or areas of expertise often have the added demands of reconciling dissimilar methods of getting the work done, of sharing information and knowledge that everyone may not have, and of taking into account the goals and objectives of multiple parties. The ideas presented here help teams meet these added demands. This paper introduces a framework that highlights three aspects of teamwork: the physical aspects (what team members do), the mental/intellectual aspects (what team members know and think), and the social/spiritual aspects (what team members feel about others' needs and objectives). These three aspects are easy to remember and intuitive to work with, and when one aspect of a team's work is strengthened, the other two are strengthened as well. (authors)
The view that the deliberative aspect of intelligent behavior is a distinct type of algorithm; in particular, a goal-seeking exploratory process using qualitative representations of knowledge and inference is elaborated. There are other kinds of algorithms that also embody expertise in domains. The different types of expertise and how they can and should be integrated to give full account of expert behavior are discussed.
In 2004, NASA faced major knowledge sharing challenges due to geographically isolated field centers that inhibited engineers from sharing their experiences, expertise, ideas, and lessons learned. The necessity to collaborate on complex development projects and the reality of constrained project resources together drove the need for ensuring that personnel at all NASA centers had comparable skill sets and that engineers could find resources in a timely fashion. Mission failures and new directions for the Agency also demanded better collaborative tools for NASA's engineering workforce. In response to these needs, the online NASA Engineering Network (NEN) was formed by the NASA Office of the Chief Engineer to provide a multi-faceted system for overcoming geographic and cultural barriers. NEN integrates communities of practice with a cross-repository search and the Lessons Learned Information System. This paper describes the features of the GN&C engineering discipline CoP site which went live on NEN in May of 2008 as an online means of gathering input and guidance from practitioners. It allows GN&C discipline expertise captured at one field center to be shared in a collaborative way with the larger discipline CoP spread across the entire Agency. The site enables GN&C engineers to find the information they need quickly, to find solutions to questions from experienced engineers, and to connect with other practitioners regardless of geographic location, thus increasing the probability of project success.
One method of selecting potential reviewers for papers submitted to the Journal of Geophysical Research Space Physics is to filter the user database within the Geophysical Electronic Manuscript System (GEMS) by areas of expertise. The list of these areas in GEMS can be self selected by users in their profile settings. The Editors have added 18 new entries to this list, an increase of 33 more than the previous 55 entries. All space physicists are strongly encouraged to update their profile settings in GEMS, especially their areas of expertise selections, and details of how to do this are provided.
With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material synthesis, characterization, analysis and discovery. Here, we explore the utility of LLMs, particularly ChatGPT4, in combination with application program interfaces (APIs) in tasks of experimental design, programming workflows, and data analysis in scanning probe microscopy, using both in-house developed APIs and APIs given by a commercial vendor for instrument control. We find that the LLM can be especially useful in converting ideations of experimental workflows to executable code on microscope APIs. Beyond code generation, we find that the GPT4 is capable of analyzing microscopy images in a generic sense. At the same time, we find that GPT4 suffers from an inability to extend beyond basic analyses for more in-depth technical experimental design. We argue that an LLM specifically fine-tuned for individual scientific domains can potentially be a better language interface for converting scientific ideations from human experts to executable workflows. Such a synergy between human expertise and LLM efficiency in experimentation can open new doors for accelerating scientific research, enabling effective experimental protocols sharing in the scientific community.
Maximizing the public impact of astronomy projects in the next decade requires NSF-funded centers to support the development of online, mobile-friendly outreach and education activities. EPO teams with astronomy, education, and web development expertise should be in place to build accessible programs at scale and support astronomers doing outreach.
Software reverse engineering (RE) requires analysts to closely read and make decisions about code. Little is known about what makes an analyst successful, making it difficult to train new analysts or design tools to augment existing ones. The goal of this project was to quantify the eye movement behaviors supporting RE and code comprehension more generally. We applied eye-tracking methods from the language comprehension literature to understand where analysts direct their attention over time when completing tasks (e.g., function identification, bug detection). Across three studies, we manipulated aspects of code hypothesized to impact comprehension (e.g., variable name meaningfulness, code complexity) and presentation methods (e.g., line-by-line, free viewing, gaze-contingent moving window) to understand effects on accuracy and gaze patterns. Results showed clear benefits of meaningful variable names, and effects of expertise on global and line-specific viewing patterns. Findings could inspire empirically-supported tool or analytic adaptations that help to reduce analyst workload.