Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Risk informed approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

J Lemery↗
NASA NTRS2024

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

Medical Operations↗
NASA NTRSDate not supplied

TBIRD, a rapid prototyping approach for design, assembly, and test of a LEO-to-ground lasercom CubeSat

The TeraByte InfraRed Delivery (TBIRD) system is a 3U payload on a 6U CubeSat launched in May 2022 which has now demonstrated space to ground links of >1 Terabyte (TB) per pass at a max data rate of 200Gbps. As a CubeSat mission, the development of the TBIRD payload was focused on low SWaP and a “rapid prototyping” approach which accepted higher risks to accelerate the schedule and reduce costs. The optomechanical design process followed standard in-house processes to develop a system that would be robust to LEO environmental loads, with a focus on the stability of the transmit (Tx) and receive (Rx) channel performance metrics. The driving requirement of maintaining 20μrad pointing error between the TX and Rx channels forced specific attention to thermal and mechanical load changes over operational conditions, which drove major design decisions. This paper describes some of engineering challenges overcome and approaches used to make TBIRD a successful program, as well as some of the tradeoffs of rapid prototyping precision optical payloads. TBIRD successfully met and exceeded the total downlink requirements listed above, with a bandwidth of 200Gbps and a total downlink of 4.8TB of information in a single pass.

TBIRD↗
NASA NTRS2014

NASA's Optical Measurement Program 2014

The Optical Measurements Group (OMG) within the NASA Orbital Debris Program Office (ODPO) addresses U.S. National Space Policy goals by monitoring and characterizing debris. Since 2001, the OMG has used the Michigan Orbital Debris Survey Telescope (MODEST) at Cerro Tololo Inter-American Observatory (CTIO) in Chile for general orbital debris surveys. The 0.6-m Schmidt MODEST provides calibrated astronomical data of GEO targets, both catalogued and uncatalogued debris, with excellent image quality. The data are utilized by the ODPO modeling group and are included in the Orbital Debris Engineering Model (ORDEM) v. 3.0. MODEST and the CTIO/SMARTS (Small and Moderate Aperture Research Telescope System) 0.9 m are both employed to acquire filter photometry data as well as synchronously observe targets in selected optical filters. Obtaining data synchronously yields data for material composition studies as well as longer orbital arc data on the same target without time delay or bias from a rotating, tumbling, or spinning target. Observations of GEO orbital debris using the twin 6.5-m Magellan telescopes at Las Campanas Observatory in Chile for deep imaging (Baade) and spectroscopic data (Clay) began in 2011. Through the data acquired on Baade, debris has been detected that reaches approx. 3 magnitudes fainter than detections with MODEST, while the spectral data from Clay provide better resolved information used in material characterization analyses. To better characterize and model optical data, the Optical Measurements Center (OMC) at NASA/JSC has been in operation since 2005, resulting in a database of comparison laboratory data. The OMC is designed to emulate illumination conditions in space using equipment and techniques that parallel telescopic observations and sourcetarget- sensor orientations. Lastly, the OMG is building the Meter Class Autonomous Telescope (MCAT) at Ascension Island. The 1.3-m telescope is designed to observe GEO and LEO targets, using a modified Ritchey-Chrétien configuration on a double horseshoe equatorial mount to allow tracking objects at LEO rates through the dome's keyhole at zenith. Through the data collection techniques employed at these unique facilities, NASA's ODPO has developed a multifaceted approach to characterize the orbital debris risk to satellites in various altitudes and provide insight leading toward material characterization of debris via photometric and spectroscopic measurements. Ultimately, the data are used in conjunction with in-situ and radar measurements to provide accurate data for models of our space environment and for facilitating spacecraft risk assessment.

Cowardin, H.↗
DOE OSTI2024

Offshore application of landslide susceptibility mapping using gradient-boosted decision trees: a Gulf of Mexico case study

Abstract Among natural hazards occurring offshore, submarine landslides pose a significant risk to offshore infrastructure installations attached to the seafloor. With the offshore being important for current and future energy production, there is a need to anticipate where future landslide events are likely to occur to support planning and development projects. Using the northern Gulf of Mexico (GoM) as a case study, this paper performs Landslide Susceptibility Mapping (LSM) using a gradient-boosted decision tree (GBDT) model to characterize the spatial patterns of submarine landslide probability over the United States Exclusive Economic Zone (EEZ) where water depths are greater than 120 m. With known spatial extents of historic submarine landslides and a Geographic Information System (GIS) database of known topographical, geomorphological, geological, and geochemical factors, the resulting model was capable of accurately forecasting potential locations of sediment instability. Results of a permutation modelling approach indicated that LSM accuracy is sensitive to the number of unique training locations with model accuracy becoming more stable as the number of training regions was increased. The influence that each input feature had on predicting landslide susceptibility was evaluated using the SHapely Additive exPlanations (SHAP) feature attribution method. Areas of high and very high susceptibility were associated with steep terrain including salt basins and escarpments. This case study serves as an initial assessment of the machine learning (ML) capabilities for producing accurate submarine landslide susceptibility maps given the current state of available natural hazard-related datasets and conveys both successes and limitations.

Dyer, Alec S. (ORCID:0000000219813904)↗
NASA NTRS2009

Human Factors in Training

Future space missions will be significantly longer than current shuttle missions and new systems will be more complex than current systems. Increasing communication delays between crews and Earth-based support means that astronauts need to be prepared to handle the unexpected on their own. As crews become more autonomous, their potential span of control and required expertise must grow to match their autonomy. It is not possible to train for every eventuality ahead of time on the ground, or to maintain trained skills across long intervals of disuse. To adequately prepare NASA personnel for these challenges, new training approaches, methodologies, and tools are required. This research project aims at developing these training capabilities. By researching established training principles, examining future needs, and by using current practices in space flight training as test beds, both in Flight Controller and Crew Medical domains, this research project is mitigating program risks and generating templates and requirements to meet future training needs. Training efforts in Fiscal Year 08 (FY08) strongly focused on crew medical training, but also began exploring how Space Flight Resource Management training for Mission Operations Directorate (MOD) Flight Controllers could be integrated with systems training for optimal Mission Control Center (MCC) operations. The Training Task addresses Program risks that lie at the intersection of the following three risks identified by the Project: (1) Risk associated with poor task design (2) Risk of error due to inadequate information (3) Risk associated with reduced safety and efficiency due to poor human factors design

Barshi, Immanuel↗
NASA NTRS2010

Human Factors in Training

Future space missions will be significantly longer than current shuttle missions and new systems will be more complex than current systems. Increasing communication delays between crews and Earth-based support means that astronauts need to be prepared to handle the unexpected on their own. As crews become more autonomous, their potential span of control and required expertise must grow to match their autonomy. It is not possible to train for every eventuality ahead of time on the ground, or to maintain trained skills across long intervals of disuse. To adequately prepare NASA personnel for these challenges, new training approaches, methodologies, and tools are required. This research project aims at developing these training capabilities. By researching established training principles, examining future needs, and by using current practices in space flight training as test beds, both in Flight Controller and Crew Medical domains, this research project is mitigating program risks and generating templates and requirements to meet future training needs. Training efforts in Fiscal Year 09 (FY09) strongly focused on crew medical training, but also began exploring how Space Flight Resource Management training for Mission Operations Directorate (MOD) Flight Controllers could be integrated with systems training for optimal Mission Control Center (MCC) operations. The Training Task addresses Program risks that lie at the intersection of the following three risks identified by the Project: 1) Risk associated with poor task design; 2) Risk of error due to inadequate information; and 3) Risk associated with reduced safety and efficiency due to poor human factors design.

Barshi, Immanuel↗
NASA NTRSDate not supplied

Designing for Advanced Aerial Mobility: Human-Autonomy Teaming and In-Time System-Wide Safety Assurance

The continued growth of aviation shall require new innovative technologies and operational concepts to meet the ever-increasing demands on air transportation. The NASA Advanced Air Mobility (AAM) project focuses on emerging aviation markets, such as Urban Air Mobility (UAM). UAM is defined as “...a safe and efficient system for air passenger and cargo transportation within an urban area. It is inclusive of small package delivery and other urban unmanned aerial system services and supports a mix of onboard/ground-piloted and increasingly autonomous operations” ([1]). The AAM project emphasizes technology development and validating system-level concepts and solutions in coordination with other NASA Aeronautics Research Mission Directorate (ARMD) projects to enable UAM metro- and micro-plex vertiport and airspace concepts of operations. The NASA AAM research portfolio includes the concepts of Remote Supervisor-in-Command (RSC) and Fleet and Airspace Manager (FAM) as possible human roles for consumer fleet providers. NASA research in RSC is focused on development of guidelines and standards for remote pilots/operators passively and actively controlling a large fleet of autonomous aircraft. For FAM, flight and ground system concepts and technologies to enable high density homogeneous operations at increased scale from vertiport(s), and coordination with other humans in the systems (e.g., UAM urban airspace manager, Air Traffic Control) are key research areas. The envisioned UAM operations are posited to require autonomous systems to enable functions ranging from fleet and resource management to vehicle control. Although automation has become increasingly sophisticated and ubiquitous in civil aviation, autonomy represents a significant evolution in automation, which has generally been limited in functional scope and capability. As autonomy takes on increasing responsibilities, humans and machines will be required to work together in new and different ways [2], rather than traditional design approaches focused on how machines (i.e., autonomy) can do the work of people. The emerging field of human-autonomy teaming (HAT) represents a comprehensive and prioritized research-driven approach to enable the success of future emerging aviation market applications through capabilities and principles that facilitate humans and machine working and thinking better together. The NASA Transformational Tools and Technologies (TTT) Autonomous System (AS) Sub-project was created to assist with the transition into higher levels of autonomy to enable new modes of air transportation, such as UAM. TTT-AS has identified HAT as a key research need to enable UAM while maintaining today’s ultra-safe aviation system safety levels. The latter challenge has been taken up by the NASA System-Wide Safety (SWS) Project, which recognizes that aviation safety, as it evolves, shall require new ways of thinking about safety to include integration of a wide-range of existing and new safety systems and practices, enhanced tools and technologies, increased access to data and data fusion, improved data analysis capabilities, enhanced in-time risk monitoring and detection, hazard prioritization and mitigation, safety assurance decision-support, and in-time integrated system analytics [3].The operational concept of UAM represents a variety of work that has been termed, “work-as-imagined” to characterize the idea that how people think that work is done and how work is actually done are often not the same [4]. To ensure design success and system safety, looking at “work-as-done” provides a comparative approach toward UAM concept and technology design through examination of corresponding analogs found today in aviation (e.g., on-demand operations) and other transportation domains (e.g., port operations). The paper shall discuss various alternative applications with specific focus on airline operation center (AOC) operations, and unmanned aerial system (UAS) command-and-control to inform scaled-versions of FAM and RSC, respectively, and with consideration of the national airspace system contextual environment. The tenets and principles of the HAT field and current NASA research efforts under the TTT-AS sub-project shall also be described. Finally, the SWS sub-project efforts to develop In-Time System-Wide Safety Assurance (ISSA) and In-Time Safety Management Systems (IASMS) are discussed in terms of how “in-time” safety assurance may be conceptualized for the on-demand mobility air taxi “work-as-imagined” operational concept [5]. As part of this effort, concepts from the emerging field of resilience engineering, are being studied. Traditional approaches to aviation safety have focused on what can go wrong and how to prevent it. Another approach to thinking about system safety should reflect not only “avoiding things that go wrong” (protective safety) but also “ensuring that things go right” (productive safety), that enables a system to exhibit the resilient performance [6] necessary for the success of the future aviation system emerging concepts of operations. The paper shall describe efforts focused on how productive safety and resilience may enable a more complete approach to system safety thinking and design of ISSA and IASMS for UAM. Future directions and research needs shall also be discussed.

resilience↗
DOE OSTI2025

ARCADE Analysis Methods & Validation Pathway

The Advanced Reactor Cyber Analysis and Development Environment (ARCADE) provides an automated analysis system which supports risk-informed performance based (RIPB) evaluations of nuclear control systems. Every possible cyber threat which could lead to consequence is identified by simulating the unsafe control action sequences which transform digital harm into physical harm. Eliminating the simulation of complex digital cyber attack chains cuts out unnecessary computational overhead and focuses directly on the physics of cyber-physical attacks. This focus enables designers to make informed decisions which can entirely eliminate categories of cyber threats against advanced reactors through the physical nature of the plant design. This narrowing of cyber threat against nuclear power plants through the physics of the system is intended to make any remaining threat management and cost efficient. This is the goal of the Tiered Cyber Analysis (TCA) outlined in NRC Draft Regulation Guide (RG) 5.96, which provides a RIPB cybersecurity approach for new reactors. ARCADE has been custom developed to meet the demands of the rigorous analysis required in Tier 1 of the TCA, which forms the foundation of the TCA process. Currently, ARCADE is still under development, but has made significant leaps in capability. A pilot analysis on the opensource Asherah simulator was performed which demonstrated key functionality goals. The next stage of ARCADE development involves improvements to the applications which support the analysis system, and enabling the analysis system to utilize the full suite of unsafe control action simulations. Since the analysis method’s core functions are complete, validation of the analysis method will be started concurrent to the next development stages. The automated analysis ARCADE will provide can radically change the cybersecurity design process for advanced reactors, reducing the cost of security implementation while enhancing cyber resilience. The pathway for ARCADE’s development to this goal has become much clearer. The majority of technical hurdles have been cleared, and the remaining development needs have been solidified. ARCADE is now capable of assisting the advanced reactor design process and directly support advanced reactor industry RIPB practices.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2005

NASA Project Constellation Systems Engineering Approach

NASA's Office of Exploration Systems (OExS) is organized to empower the Vision for Space Exploration with transportation systems that result in achievable, affordable, and sustainable human and robotic journeys to the Moon, Mars, and beyond. In the process of delivering these capabilities, the systems engineering function is key to implementing policies, managing mission requirements, and ensuring technical integration and verification of hardware and support systems in a timely, cost-effective manner. The OExS Development Programs Division includes three main areas: (1) human and robotic technology, (2) Project Prometheus for nuclear propulsion development, and (3) Constellation Systems for space transportation systems development, including a Crew Exploration Vehicle (CEV). Constellation Systems include Earth-to-orbit, in-space, and surface transportation systems; maintenance and science instrumentation; and robotic investigators and assistants. In parallel with development of the CEV, robotic explorers will serve as trailblazers to reduce the risk and costs of future human operations on the Moon, as well as missions to other destinations, including Mars. Additional information is included in the original extended abstract.

Dumbacher, Daniel L.↗
DOE OSTI2023

Design and requirements of a hydrogen component reliability database (HyCReD)

Hydrogen technologies are expected to play a key role in the decarbonization of several sectors including energy storage and transportation. Rigorous investigation and quantification of the risk and reliability issues associated with hydrogen technologies will be critical to ensuring both their wider adoption and safe, economical operations. Quantitative risk assessment (QRA) is an important tool that has been used to enable the safe deployment of many engineering systems, including hydrogen fueling stations and hydrogen storage systems. However, QRA studies require reliability data which is currently lacking for expanding applications of hydrogen systems. Here, to address this gap, we present a new structure for a hydrogen component reliability database (HyCReD) that can be used to generate reliability data to be used in QRA, reliability, safety studies, maintenance planning, and more. Building on our previous work examining four major hydrogen safety data collection tools (West et al., 2022) [1], our approach in this work was to consult scientific literature on reliability data collection as well as a number of existing reliability engineering databases in the oil & gas, chemical processing, and nuclear power plant sectors. The evaluation of these databases led to identifying best practices to be implemented in a data collection framework for a hydrogen component reliability database. Based on these best practices, a set of 24 requirements for the proposed database are presented, covering its characteristics and the types of data to be collected. We define the structure of the HyCReD database and 25 data elements to be collected, spanning system description, failure, shutdown, or near-miss events, and maintenance events. The data elements are then defined according to international standards used in the safety and reliability practice and potential choice lists are provided for each field. Since this database is being piloted for hydrogen fueling stations, a generic station component hierarchy developed by West (2021) [2] is used to standardize system data. Finally, we demonstrate populating the database with information extracted from five narrative reports on hydrogen fueling station incidents.

08 HYDROGEN↗
DOE OSTI2025

Risk assessment of wellbore leakage during underground hydrogen storage

The expansion of renewable energy sources would require large-scale energy storage options to overcome the intermittent nature of these sources. Underground hydrogen storage (UHS) in depleted hydrocarbon reservoirs offers a scalable and practical energy storage solution. These reservoirs are chosen for their availability and large capacity, but the unique properties of hydrogen raise concerns about potential leakage pathways, particularly through wellbores. In this study, we develop and apply, for the first time, reduced-order models (ROMs) specifically designed for efficient leakage risk prediction in UHS systems operating in depleted hydrocarbon reservoirs. Using 3,000 high-fidelity simulation scenarios, we examine the influence of 11 key parameters, including reservoir and aquifer depths, wellbore permeability and porosity, initial saturations of water, oil and gas fractions (hydrogen, light, intermediate, and heavy hydrocarbons), reservoir pressure multiplier, and the aquifer-to-reservoir volume ratio, to simulate leakage behavior over a 1,000-year timescale. We train ROMs using a two-step classification-regression approach, achieving R 2 values exceeding 99 % across all targets. These ROMs effectively capture the leakage evolution and identify critical controls of leakage, guiding the design of mitigation strategies. Results indicate that gas leakage occurs in about 27 % of scenarios as early as five years post-operation, reaching volumes of up to 106 ft3. Oil leakage is less frequent (~17 %) and typically begins decades later. Our findings also show that hydrogen often migrates first, owing to its smaller molecular size and higher buoyancy, followed by heavier hydrocarbons. Over time, these heavier components contribute significantly to the total leaked volume, reinforcing the need for targeted monitoring and remediation strategies. Our analysis highlights that deeper storage reservoirs, shallower aquifers, and low-permeability wellbores significantly reduce leakage risks. In conclusion, this work offers a robust framework for risk-informed UHS deployment, supporting energy security through reliable large-scale hydrogen storage while safeguarding environmental integrity.

08 HYDROGEN↗
DOE OSTI2021

A hierarchical evaluation framework for assessing climate simulations relevant to the energy-water-land nexus (Final Report)

The overarching goal was to construct a hierarchy of new and well-tested metrics and analysis tools that support both fundamental and use-inspired research. Motivating this goal was a convergence of needs from climate scientists and stakeholders alike for a systematic, robust framework of model evaluation and diagnosis to provide scientific insights, inform model development, support best practices for the use of climate model outputs, and facilitate communication of climate information in the evolving landscapes of multi-model, multi-resolution, and large ensemble simulations that generate terabytes of data for any single climate run. Steps toward attaining these goals benefited from expertise and established capability of the project team, which included leadership of the North American Regional Climate Change Assessment Program (NARCCAP) and the Coordinated Regional Downscaling Experiment (CORDEX), development of hierarchical model evaluation approaches, and successful research in the analysis and diagnosis of climate model skill, as well as the understanding and modeling of regional climate processes in North America. As part of the overarching goal, the project worked to disseminate a suite of methodologies, algorithms, and software components that the wider community can employ to advance climate science and applications. With rigorous demonstration, the evaluation framework and the mix of standard and high risk / high reward approaches helped form the basis for future development of a computationally enabled user-friendly system for community use.

17 WIND ENERGY↗
DOE OSTI2022

APPLICATION OF OBJECTIVES-DRIVEN ASSURANCE CASES TO SYSTEM DEVELOPMENT IN AN EVOLVING ACQUISITION MODEL

System properties such as “safety” and “dependability” cannot, in practice, be proven, and must be argued in an “assurance case” aimed at supporting risk-acceptance decisions that have to be made by system acquirers and/or regulatory authorities. The paper is concerned with applications of the “assurance case” idea early in design and development of new systems, when (apart from dedicated testing) the only available operating experience information derives from previous (non-identical) systems. Much of the discussion is based on an evolving acquisition model at the US National Aeronautics and Space Administration; previously, most major systems were developed in-house, but some major systems will now be developed by and acquired from commercial providers. Key points discussed include the following. (1) By promoting a particular kind of focused discussion between acquirers and providers, the use of assurance cases should be particularly valuable under the new acquisition model. (2) In principle, objectives-driven (sometimes called “performance-based”) approaches to assurance of performance have significant advantages in cases where they are applicable. (3) For truly novel systems, completeness of the safety analysis is a significant issue; it is important for the assurance case to include a commitment by the provider (or applicant) to seriously pursue analysis of operating experience, so that previously unrecognized hazards can be identified and addressed. (4) Inquiries into major accidents often point to deficiencies in management oversight in all parts of the life cycle; management processes need to be addressed in the formulation and the implementation of an assurance case. Under the new acquisition model, these considerations imply a serious reconsideration of the way in which the development process is managed by both providers and acquirers.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Application of Objectives-Driven Assurance Cases to System Development in an Evolving Acquisition Model

System properties such as “safety” and “dependability” cannot, in practice, be proven, and must be argued in an “assurance case” aimed at supporting risk-acceptance decisions that have to be made by system acquirers and/or regulatory authorities. The paper is concerned with applications of the “assurance case” idea early in design and development of new systems, when (apart from dedicated testing) the only available operating experience information derives from previous (non-identical) systems. Much of the discussion is based on an evolving acquisition model at the US National Aeronautics and Space Administration; previously, most major systems were developed in-house, but some major systems will now be developed by and acquired from commercial providers. Key points discussed include the following. (1) By promoting a particular kind of focused discussion between acquirers and providers, the use of assurance cases should be particularly valuable under the new acquisition model. (2) In principle, objectives-driven (sometimes called “performance-based”) approaches to assurance of performance have significant advantages in cases where they are applicable. (3) For truly novel systems, completeness of the safety analysis is a significant issue; it is important for the assurance case to include a commitment by the provider (or applicant) to seriously pursue analysis of operating experience, so that previously unrecognized hazards can be identified and addressed. (4) Inquiries into major accidents often point to deficiencies in management oversight in all parts of the life cycle; management processes need to be addressed in the formulation and the implementation of an assurance case. Under the new acquisition model, these considerations imply a serious reconsideration of the way in which the development process is managed by both providers and acquirers.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Tactical Analysis for Calculating Contextual Risk at Boundaries: Summary of Laboratory Directed Research & Development Effort

The Tactical Analysis for Calculating Contextual Risk at Boundaries (TACCRAB) tool is an innovative digital twin (DT) platform and automated risk algorithm designed to transform operational decision-making in structured screening environments, with an initial focus on Southern Border Land Ports of Entry (POEs). The invention provides integration points for advanced artificial intelligence, predictive modeling, and real-time data analysis to produce a comprehensive risk management tool that enables proactive, data-informed security strategies. The core inventive features of TACCRAB center on its unique risk algorithm, which dynamically calculates contextual risk by synthesizing historical data, near real-time streaming data from the checkpoints themselves, and AI-generated predictions. Unlike traditional risk assessment methods, TACCRAB utilizes a DT to provide comprehensive operational insights, allowing stakeholders to visualize, simulate, and optimize checkpoint configurations with unprecedented speed and contextual awareness. TACCRAB's key innovation lies in its ability to combine multiple complex inputs - including technology detection probabilities, resource availability, screening pathway characteristics, and threat actor behavioral patterns - into a unified risk calculation and update these inputs based on changing operational and environmental conditions. By leveraging a DT that continuously updates and learns from linked data, TACCRAB can suggest adaptive mitigation strategies that minimize risk while maintaining operational efficiency. Particularly novel is the platform's approach to decision support, which goes beyond static risk assessment. The DT provides dynamic metrics such as wait times, resource allocation effectiveness, and potential emerging threat scenarios, enabling users to view sophisticated, relevant what-if simulations and optimize checkpoint operations in near real-time. The system's architecture allows for generalized application across different screening environments, such as secure facilities, ports of entry, and soft targets, making it a versatile tool for security and operational management. The invention distinguishes itself through its comprehensive integration of predictive modeling, AI-driven pattern discovery, and user-friendly interface design. By combining these elements, TACCRAB transforms complex risk data into actionable insights, supporting decision-makers at various organizational levels - from booth agents making split-second screening decisions to checkpoint managers optimizing the day's resource allocation to strategic planners managing long-term investments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

Evaluating the Effectiveness of an Ultrasonic Acoustic Deterrent in Reducing Bat Fatalities at Wind Energy Facilities

This project was designed to use thermal video cameras and fatality monitoring to evaluate the effectiveness of an ultrasonic acoustic deterrent (UAD) on bat activity and mortality, respectively. Our goals were to redesign the UAD device and installation infrastructure, determine the placement on wind turbines to optimize safety, compatibility and functionality, and to compare the mortality among the following conditions: Control (deterrents off and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Deterrent (deterrents on and turbines feathered up to the manufacturer’s cut-in speed of 3.5 m/s), Curtailment (deterrents off and turbines feathered up to 5/ m/s), and combination (deterrents on and turbines feathered up to 5 m/s). The project was divided into a Feasibility Study and Comparative Study. The objectives for the Feasibility Study were to develop an installation strategy, redesign a previous iteration of a UAD to improve performance and weatherization, and test the effectiveness of the deterrents on bat activity. The Feasibility Study was intended to work out potential issues using a relatively small number of devices prior to manufacturing and installing numerous devices for a larger-scale comparative study. The division of the project into these separate studies was based on previous experience and the challenges of assessing the capabilities of an untested UAD. During the initial development and manufacturing of the UAD, NRG Systems decided to use a piezoelectric transducer rather than an electrostatic transducer, which was used by a previous device (i.e. Deaton UAD). NRG Systems conducted lab testing (i.e., IP67 or Ingress Protection) to ensure no water or dust ingress. In addition, shock/drop trials and variations in temperature exposure were conducted as part of the reliability testing. NRG Systems also developed a communications system to allow for continuous performance monitoring of the UADs. For the Feasibility Study, we installed 6 UADs on each of 2 Gamesa G90 2-MW wind turbines (Turbine 14 and 8) at the South Chestnut Wind Energy Facility, Pennsylvania and monitored activity under control and treatment (i.e. Deterrent) conditions using thermal video monitoring. There are two major sources of variation in bat activity (beyond the anticipated treatment effect): 1) environment around the turbines might inherently favor more activity at one than the other; 2) weather conditions on any given night or within season difference (e.g., migration later during the study period) might favor more activity on some nights than on other nights. Because we could only monitor two turbines on any night, we sought to control the potential influences of these two sources by alternating the turbine on which deterrents were activated each night. If there were no loss of data due to technical failures, this design would result in an equal number of deterrent and control nights at each turbine through the monitoring period, balancing the effects of both sources of variation. We compared the time bats spent and the number of events that occurred in overlapping cameras FOV as an indicator of risk, since 80% of the overlapping FOV of the cameras was in the RSA. Equipment failures, majority due to lightning, resulted in only 17 nights with useable data, with unbalanced treatment assignment within turbines and uneven distribution of treatment assignment throughout the observational period. This resulted in a confounding of treatment assignment and seasonal change. Deterrent treatment was measured at Turbine 14 on only 2 of the first 8 usable nights (spanning the period from 8/18-9/17), whereas 6 times on Turbine 8. From 9/18-927, deterrent was on at Turbine 14 on 6 of the remaining 10 nights, and 4 on Turbine 8. We recorded a total of 1,057 bats and observed a reduction in number of events and duration of events at the UAD-activated turbine when it was Turbine 14. When Turbine 8 had the UAD activated, we observed no difference in number or duration of events. Variation between turbines is not unusual and can cause issues when study designs have no true replication, i.e., multiple turbines per treatment. Within-turbine differences suggested a trend for reduced activity when UADs were activated, particularly for Turbine 14. These results may be caused by the overall higher bat activity at Turbine 8 and confounding of treatment assignment and seasonal trends. We mapped 58 bat events in 3-dimensional space (3D), 30 and 28 events during control and treatment conditions, respectively. We observed bats crossing the rotor plane under both control and treatment conditions and observed a total of 40 confirmed or near-collisions (i.e., target close to blade but no visual confirmation of a strike) out of a total of 1,491 medium and high confidence bat observations (880 control, 611 at treatment). Twice as many collisions/possible collisions were observed during control conditions. Given the challenges with the equipment and potential confounding of the data (i.e., different activity levels at the two wind turbines), we were unable to determine whether this initial turbine placement and orientation was optimal. Given no new information on how best to install the devices, we elected to use the same placement and orientation for the comparative study. For the Comparative Study, the objectives were to investigate the relative mortality rates among 4 treatments. We searched the area within 90 m of each turbine daily to recover the highest number of fresh fatalities possible. We were unable to detect a clear reduction in mortality from deterrents alone for any individual species. Surprisingly, mortality rate of the eastern red bat (Lasiurus borealis) was estimated to be 1.3–4.2 times as much when turbines were operating normally and UADs were on than when UADs were off. Reduction in mortality of all bat species combined due to curtailment of turbines was estimated to be between 0%–38%. This effect was nullified when, in addition to curtailment, UADs were on, with 95% confidence interval ranging from a 45% reduction to a 36% increase in mortality. This was likely due to the large proportion of eastern red bats in the total carcass population. Mortality of all low-frequency echolocating bats combined (i.e. hoary bat [L. cinereus], big brown bat [Eptesicus fuscus], silver-haired bat [Lasionycteris noctivagans]) relative to control was lower when curtailed (95% CI: 0%–74%), but the addition of UADs had no detectable effect (95%CI: 13%–79%). The combined treatment reduced mortality in silver-haired bats relative to control by 11%–99%, compared to curtailment (81% reduction–67% increase) or deterrent (82% reduction–67% increase) alone. Because silver-haired bats comprised a large proportion of low-frequency calling bats found during this study, a similar effect was seen for that group. The higher mortality observed for eastern red bats at UAD compared to control could have been caused by several factors, such as the effective range of the UAD, particularly at higher frequencies, behavior, positioning of the devices on the nacelle, or a combination of these. We used 3D thermal videography to compare control and UAD bat behavior from two turbines using a total of 203 3D bat-tracks across 34 nights. We recorded a similar number of bat-tracks between treatment groups, with 51% and 49% for control and UAD, respectively. Due to potential differences in bat behavior around spinning vs stationary turbine blades, we examined UAD effectiveness separately for non-operating turbines (feathered below cut-in speed of 3.5 m/s) and operating (normal operation above wind speed of 3.5 m/s). We found a higher proportion of bat-tracks at operating turbines (82%) compared to non-operating turbines (18%), although this does not account for overall time turbines were operating versus not. At non-operating turbines the UAD appears to be effective at reducing the amount of time, flight length, and number of passes through the rotor plane, compared to control. In addition, we found bats approached turbines similarly between control and treatment turbines, with 61% of control and 63% of UAD bat-tracks originating leeward of the hub. In contrast, at operating turbines, we saw little change in bat behavior in response to UADs. For example, we found an increase in the average duration of bat-tracks between non-operating and operating turbines for UAD but at control turbines we found average duration decreased once turbines became operational. Both control and UAD had a high proportion of bat-tracks that crossed the rotor plane (i.e., collision risk) originate from the windward side when turbines were operational 65% to 92%, respectively. Given that the UAD devices closest to the blades were orientated parallel to the blades, its possible bats were not exposed to the signal until they were close to the turbine blades, as suggested by the slightly higher mean duration within 5 meters of the blades for UAD turbines. Future research should consider concentrating UAD intensity on the areas of risk (i.e. blades) with enough buffer to allow bats to react to the sound before entering the rotor-swept area (RSA). In addition, investigating the potential of installing UAD units windward of the turbine blades (e.g. a hub-mounted UAD), particularly since even under control conditions, a relatively high proportion (65%) of crosses through the blade plane originated windward. 3D thermal videography provided valuable information on future testing strategies (e.g. device placement, UAD orientation) to improve UAD effectiveness when bats are at risk (i.e., operating wind turbines). Across the entire project we experienced issues with the operation and communication with the UADs. Most of the issues occurred during the Feasibility Study and were resolved prior to the Comparability Study. Additional challenges surfaced during the Comparability Study but were remedied immediately and are thought to have little impact on the results. We had logistical constraints at the project that limited our ability use traditional methods in our camera calibration. Several calibrations showed inaccurate scales, which may have been related to inadequate spatial coverage of “points” in the camera calibration volume. Because we were using actual video recordings of bats at a wind turbine, the behavior of bats could have concentrated “points” in specific areas of the turbine (i.e. leeward of nacelle), and limited “points” in other areas, resulting in camera calibration issues. We have plans to address these inconsistencies and improving the software and related methodologies by early 2020.

17 WIND ENERGY↗
NASA NTRS2014

NASA's Optical Measurement Program 2014

The Optical Measurements Group (OMG) within the NASA Orbital Debris Program Office (ODPO) addresses U.S. National Space Policy goals by monitoring and characterizing debris. Since 2001, the OMG has used the Michigan Orbital Debris Survey Telescope (MODEST) at Cerro Tololo Inter-American Observatory (CTIO) in Chile for general orbital debris survey. The 0.6-m Schmidt MODEST provides calibrated astronomical data of GEO targets, both catalogued and uncatalogued debris, with excellent image quality. The data are utilized by the ODPO modeling group and are included in the Orbital Debris Engineering Model (ORDEM) v. 3.0. MODEST and the CTIO/SMARTS (Small and Moderate Aperture Research Telescope System) 0.9 m both acquire filter photometric data, as well as synchronously observing targets in selected optical filters. This information provides data used in material composition studies as well as longer orbital arc data on the same target, without time delay or bias from a rotating, tumbling, or spinning target. NASA, in collaboration with the University of Michigan, began using the twin 6.5-m Magellan telescopes at Las Campanas Observatory in Chile for deep imaging (Baade) and spectroscopic data (Clay) in 2011. Through the data acquired on Baade, debris have been detected that are ~3 magnitudes fainter than detections with MODEST, while the data from Clay provide better resolved information used in material characterization analyses via selected bandpasses. To better characterize and model optical data, the Optical Measurements Center (OMC) at NASA/JSC has been in operation since 2005, resulting in a database of comparison laboratory data. The OMC is designed to emulate illumination conditions in space using equipment and techniques that parallel telescopic observations and source-target-sensor orientations. Lastly, the OMG is building the Meter Class Autonomous Telescope (MCAT) at Ascension Island. The 1.3-m telescope is designed to observe GEO and LEO targets, using a modified Ritchey-Chrétien configuration on a double horseshoe equatorial mount to allow tracking objects at LEO rates through the dome's keyhole at zenith. Through the data collection techniques employed at these unique facilities, NASA's ODPO has developed a multi-faceted approach to characterize the orbital debris risk to satellites in various altitudes and provide material characterization of debris via photometric and spectroscopic measurements. Ultimately, the data are used in conjunction with in-situ and radar measurements to provide accurate data for models of our space environment and service spacecraft risk assessment.

Cowardin, H.↗