Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “lifecycle assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

SCRL-Model for Human Space Flight Operations Enterprise Supply Chain

This paper will present a Supply Chain Readiness Level (SCRL) model that can be used to evaluate and configure adaptable and sustainable program and mission supply chains at an enterprise level. It will also show that using SCRL in conjunction with Technology Readiness Levels (TRLs), Manufacturing Readiness Levels (MRLs) and National Aeronautics Space Administrations (NASA s) Project Lifecycle Process will provide a more complete means of developing and evaluating a robust sustainable supply chain that encompasses the entire product, system and mission lifecycle. In addition, it will be shown that by implementing the SCRL model, NASA can additionally define supplier requirements to enable effective supply chain management (SCM). Developing and evaluating overall supply chain readiness for any product, system and mission lifecycle is critical for mission success. Readiness levels are presently being used to evaluate the maturity of technology and manufacturing capability during development and deployment phases of products and systems. For example, TRLs are used to support the assessment of the maturity of a particular technology and compare maturity of different types of technologies. MRLs are designed to assess the maturity and risk of a given technology from a manufacturing perspective. In addition, when these measurement systems are used collectively they can offer a more comprehensive view of the maturity of the system. While some aspects of the supply chain and supply chain planning are considered in these familiar metric systems, certain characteristics of an effective supply chain, when evaluated in more detail, will provide an improved insight into the readiness and risk throughout the supply chain. Therefore, a system that concentrates particularly on supply chain attributes is required to better assess enterprise supply chain readiness.

Tucker, Brian↗

Space Launch System Accelerated Booster Development Cycle

With the retirement of the Space Shuttle, NASA is seeking to reinvigorate the national space program and recapture the public s interest in human space exploration by developing missions to the Moon, near-earth asteroids, Lagrange points, Mars, and beyond. The would-be successor to the Space Shuttle, NASA s Constellation Program, planned to take humans back to the Moon by 2020, but due to budgetary constraints was cancelled in 2010 in search of a more "affordable, sustainable, and realistic" concept2. Following a number of studies, the much anticipated Space Launch System (SLS) was unveiled in September of 2011. The SLS core architecture consists of a cryogenic first stage with five Space Shuttle Main Engines (SSMEs), and a cryogenic second stage using a new J-2X engine3. The baseline configuration employs two 5-segment solid rocket boosters to achieve a 70 metric ton payload capability, but a new, more capable booster system will be required to attain the goal of 130 metric tons to orbit. To this end, NASA s Marshall Space Flight Center recently released a NASA Research Announcement (NRA) entitled "Space Launch System (SLS) Advanced Booster Engineering Demonstration and/or Risk Reduction." The increased emphasis on affordability is evident in the language used in the NRA, which is focused on risk reduction "leading to an affordable Advanced Booster that meets the evolved capabilities of SLS" and "enabling competition" to "enhance SLS affordability. The purpose of the work presented in this paper is to perform an independent assessment of the elements that make up an affordable and realistic path forward for the SLS booster system, utilizing advanced design methods and technology evaluation techniques. The goal is to identify elements that will enable a more sustainable development program by exploring the trade space of heavy lift booster systems and focusing on affordability, operability, and reliability at the system and subsystem levels5. For this study, affordability is defined as lifecycle cost, which includes design, development, test, and engineering (DDT&E), production and operational costs (P&O). For this study, the system objectives include reducing DDT&E schedule by a factor of three, showing 99.9% reliability, flying up to four times per year, serving both crew and cargo missions, and evolving to a lift capability of 130 metric tons.3 After identifying gaps in the current system s capabilities, this study seeks to identify non-traditional and innovative technologies and processes that may improve performance in these areas and assess their impacts on booster system development. The DDT&E phase may be improved by incorporating incremental development testing and integrated demonstrations to mitigate risk. To further reduce DDT&E, this study will also consider how aspects of the booster system may have commonality with other users, such as the Department of Defense, commercial applications, or international partners; by sharing some of the risk and investment, the overall development cost may be reduced. Consideration is not limited to solid and liquid rocket boosters. A set of functional performance characteristics, such as engine thrust, specific impulse (Isp), mixture ratio, and throttle range are identified and their impacts on the system are evaluated. This study also identifies how such characteristics affect overall life cycle cost, including DDT&E and fixed and variable P&O.

Arockiam, Nicole↗

On the Formalization of Development and Assessment Process for Digital Twins in the Nearly Autonomous Management and Control System

In recent years, the autonomous control system has been encouraged in advanced reactors for restoring economic viability, simplifying the operation and maintenance, and enabling remote-site power generations [1]. Since the reactor is expected to be operated for a long period of time with a limited number of individuals onsite, it is recommended that the autonomous control system should have access to very realistic models of the state of processes in the whole lifecycle, together with these process behaviors in interaction with their environment in the real world. As a result, digital twin (DT) technology is suggested in autonomous control systems. DT is defined as a digital representation of a physical object or system, which contains a record for the histories of loads, operation and maintenance status, predictions for the near-term transient of important state variables, and decision-making process [2]. Since machine learning (ML) can recognize patterns within a complex system in real-time applications, it has been used to build DTs in the autonomous control systems for advanced reactors. Meanwhile, due to the rareness of operation data in accident scenarios, the development and assessment of DTs is expected to be mainly driven by simulations. Although the capability and feasibility of ML-based DTs are recognized in improving the safety and efficiency of reactor control, a major concern from the regulatory commission and the nuclear industry is whether the information from a DT is developed and assessed in accordance with expectation and requirements by the target decision. Such concerns not only affect the acceptance criteria for DTs, but also values that can be extracted from DTs and autonomous control system during operations. Inspired by the success of formal methods in improving the reliability and robustness of computer programming and software development, it is suggested that the development and assessment process (DAP) for both separate DTs and integral control system should be formalized in a transparent, consistent, and improvable manner. In this study, a digital-twin development and assessment process (DT-DAP) is proposed by adapting the evaluation model development and assessment process (EMDAP) [3] to requirements by the autonomous control system, ML algorithms, and DT technology. To demonstrate the framework, a baseline nearly autonomous management and control (NAMAC) system with ML-based DTs for diagnosis and prognosis is developed and assessed based on the framework. It is found that with selected testing methods and techniques, the DT-DAP can help identify errors in DTs and NAMAC which would otherwise be left unverified. Meanwhile, it is found that the DT-DAP can improve the DTs and NAMAC by continuously learning and iterating through different elements.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

First Solar Thermal Energy Planner (STEP 1) and Nationwide Industrial Heat and Power Analysis

The First Solar Thermal Energy Planner (STEP 1) and Nationwide Industrial Heat and Power Analysis (aka the STEP 1 Project or the Project) aimed to (1) developed a brand-new web tool that could provide decision support through free, rapid techno-economic analysis of behind-the-meter solar+storage systems for industrial process heat and (2) conduct high-level analyses of the cost-competitiveness of the same systems across the US in key sectors. The STEP 1 web tool collects key location, land availability, thermal load profile, proccess heat temperature and media, and other key parameters through an easy-to-use user interface (UI). The UI was designed to meet the user at their level of understanding by minimizing the number of required inputs as much as possible while including options for more nuanced inputs if the user desires. STEP 1 advises users on which solar thermal tehcnologies that could fit their needs based on the inputs provided (namely process media and temperature). The tool can model a wide range of solar thermal technologies including flat plate collectors, evacuated tubes, parabolic troughs, linear Fresnel, and molten salt towers all with corresponding thermal energy storage (TES) - solar PV with resistive heating and TES is also included. Once the parameters are collected, a nominal thermal energy production profile for the facility's location is generated using NREL's System Advisory Model (SAM) and then passed to a modified version of NREL's REopt platform to optimize the size (capacity) and dispatch of the solar+storage system to minimize lifecycle costs subject to energy balance, fuel and electricity rates, emission reductions goals, and other constraints. This entire process takes less than 20 minutes, is completely free, requires zero coding skills, and provides the user with a high-level assessment on the techno-economic feasability of deploying solar+storage systems for their energy needs. In addition to the development of the STEP 1 web tool, the project completed two complementary analyses focused on leveraging the backend code of STEP 1, public industrial facility locations and fuel consumption data, and key sector information to assess the economic opportunity of reducing fuel costs at various levels of capacity factor around the US. Both analyses found that there are key markets, locations, industrial sectors (namely food and beverage), and degrees of offset where solar thermal technologies could be cost-effectively deployed, highlighting a key market entry point for these technologies, and assessing deployment potential. In summary, the STEP 1 project improved the opportunities for solar+storage systems to expand into the industrial process heat market through breaking down barriers to assessing these technologies.

14 SOLAR ENERGY↗

A techno-economic assessment of carbon dioxide removal pathways via biochemical conversion of lignocellulose to biofuels and bioplastics

Biomass carbon removal and storage (BiCRS) is a promising pathway to mitigate climate change via large scale removal of atmospheric carbon dioxide (CO 2 ). We modeled several fermentation technologies, producing a variety of bioproducts from lignocellulosic feedstocks, to understand their levelized cost of CO 2 removal under multiple scenarios. Lifecycle greenhouse gas (GHG) emissions are accounted to provide cradle-to-grave estimates of carbon intensity (CI). We did not account for the avoided fossil CO 2 emissions from the use of biofuels in our CO 2 removal cost calculations, because avoided emissions do not contribute to CO 2 removal. The main products from the fermentation technologies we modeled include renewable diesel, ethanol, sustainable aviation fuel (SAF), and polyethylene (PE), with co-products including CO 2 , adipic acid, steam, and electricity. PE, depending on its end-of-life management, can serve as a form of biogenic carbon storage. PE has the potential to remove 1.2–1.5 tCO 2 per dry t-biomass, whereas biofuels have the potential to remove 0.3–0.9 tCO 2 per dry t-biomass, indicating that PE production is a more efficient method of carbon removal. We quantify costs of CO 2 removal to be $\$$60 – $\$$675 per metric tCO 2 removed across the various fermentation pathways. Under the scenarios analyzed, bioplastic production from lignocellulosic biomass is a more cost-effective route to CO 2 removal than biofuel production, with costs of CO 2 removal via bioplastics being 50–90 % lower than that of biofuels. Future research should explore the potential benefits and drawbacks of expanding bioplastic production for large-scale CO 2 removal.

09 BIOMASS FUELS↗

Shallow- and deep-convection characteristics in the greater Houston, Texas, area using cell tracking methodology

The convective lifecycle, from initiation to maturity and dissipation, is driven by a combination of kinematic, thermodynamic, microphysical, and radiative processes that are strongly coupled and variable in time and space. Weather radars have been traditionally used to provide various convective-cloud characteristics. Here, we analyzed climatological convective-cell radar characteristics to obtain and assess the diurnal cycles of three convective-cell types – shallow, modest deep, and vigorous deep convective cells – that formed in the greater Houston area, using the National Weather Service radar from Houston, Texas, and a multi-cell identification and tracking algorithm. The examined dataset spans 4 years (2018–2021) and covers the warm-season months (June to September) in those years. The analysis showed clear diurnal cycles in cell initiation (CI) consistent with the sea breeze circulation and showed diurnal and normalized lifetime relationships in cell evolution parameters (e.g., maximum reflectivity, echo-top height, Geostationary Operational Environmental Satellite-16 (GOES-16) channel 13 brightness temperature, and the height of maximum reflectivity). The cell evolution is well represented by relationships between (1) the height and value of the maximum radar reflectivity, (2) the minimum GOES-16 channel 13 brightness temperature and the maximum vertically integrated liquid, (3) the maximum reflectivity and columnar-average reflectivity, and (4) the echo-top ascent rate and cell lifetime. The relationships presented herein help to identify the cell lifecycle stages such as early shallow convection, vigorous vertical development, anvil development, and convective core dissipation. GOES-16 Aerosol Optical Depth values are also used as a proxy for cell initiation aerosol concentrations to investigate any potential relationships between initiation location and aerosol concentration. Overall, no significant relationships between initiation location and aerosol concentration were found for the three cell types investigated, but there are some minor differences in the pre-CI aerosol optical depth for vigorous deep convective cells.

54 ENVIRONMENTAL SCIENCES↗

Lighting Policy Options to Incentivize the Circular Economy

Energy codes and energy efficiency policy are primed for significant shifts in the coming decade. Consumers are increasingly asking manufacturers to take responsibility for products over the course of the product lifespan, including at end-of-life. Consumer demand for social and environmental responsibility may push new codes and policies that incentivize the circular economy. Within the lighting sector, for example, rapid innovations have created large energy savings but also created a complex waste stream. Traditional energy code approaches to lighting efficiency have considered only lighting power density or energy-based metrics. Shifting codes and policy to consider environmental impacts of the product lifecycle could include circular economy mechanisms such as product deposits or service-based business models. In this paper we consider the possible structures for both codes and policies, and provide an analysis of the merits of each policy using life cycle assessment and sustainability index (SI).

Dillon, Heather↗

Generalized implementation of software safety policies

As part of a research program in the engineering of software for safety-critical systems, we are performing two case studies. The first case study, which is well underway, is a safety-critical medical application. The second, which is just starting, is a digital control system for a nuclear research reactor. Our goal is to use these case studies to permit us to obtain a better understanding of the issues facing developers of safety-critical systems, and to provide a vehicle for the assessment of research ideas. The case studies are not based on the analysis of existing software development by others. Instead, we are attempting to create software for new and novel systems in a process that ultimately will involve all phases of the software lifecycle. In this abstract, we summarize our results to date in a small part of this project, namely the determination and classification of policies related to software safety that must be enforced to ensure safe operation. We hypothesize that this classification will permit a general approach to the implementation of a policy enforcement mechanism.

Knight, John C.↗

Application of quantitative risk assessment to address stakeholder questions in geologic carbon storage

Ambitious international greenhouse gas emissions reduction targets demand a rapid transformation to a low-carbon economy. This transformation includes the accelerated adoption of carbon dioxide (CO2) capture and storage (CCS) technology. However, as with any large-scale engineering enterprise, the widespread commercial-scale deployment of geologic carbon storage (GCS) raises important questions about technology and cost-effectiveness, safety, environmental risk, and long-term liability. Effectively assessing and managing risks and liability associated with GCS projects is a key technical need throughout the project life cycle-from site selection and permitting to monitoring design, operational risk management, and post-operational site closure. This presentation highlights recent advancements in tools for quantitative risk assessment, being developed by the National Risk Assessment Partnership (NRAP). NRAP is a multi-year, multinational laboratory research collaboration sponsored by the U.S. Department of Energy's Office of Fossil Energy and Carbon Management. Our focus will be on these tools' applications in addressing critical stakeholder questions related to supporting permitting to ensure secure and environmentally protective storage; designing effective and efficient monitoring plans; evaluating the effectiveness of remedial actions and risk management alternatives; and informing liability assessment and investment decisions. This paper will detail the key functionality of NRAP’s Open-Source Integrated Assessment Model (NRAP-Open-IAM), a computational framework for assessing leakage risk and containment assurance. This model features streamlined workflows for calculating leakage risk profiles, delineating risk-based area of review, and assessing contingency plans and post-injection site care requirements. ORION is an open-source, observation-based ensemble forecasting toolkit to help operators assess the seismic hazard at a carbon storage site. The State of Stress Analysis Tool (SOSAT), designed to assess subsurface stress conditions and evaluate geomechanical risk resulting from CO2 injection in an area of interest will also be presented. We will also introduce a prototype model to evaluate storage project costs and liability associated with risk management. The Technoeconomic and Liability Evaluation for Storage (TALES) model uses results from forecasts of leakage and induced seismicity risk to estimate the lifecycle cost of managing risk. Finally, a preliminary example of how the NRAP Risk-based Adaptive Monitoring Plan (RAMP) tool can be used to design efficient and effective site monitoring plans and estimate the detectability of fluid leakage will be provided. The relevance of these tools for addressing key stakeholder questions amidst uncertainty will be emphasized.

decision support↗

Application of Manufacturing Quality Management Principles to PV System Installations

To help SETO/DOE achieve its goals, the IBTS team proposed a project addressing system reliability by improving installation standards and quality management. The proposed approach was designed to help achieve measurable reductions in installation defect density and improvements in the performance of PV systems by optimizing design and installation of residential and commercial PV systems. This approach addressed the soft costs associated with installations and quality management. The project demonstrated improved system reliability and reduced PV system installation costs. The software developed improved operations, decreased risk, and increased the overall value of PV systems across their lifecycle. The project used several data collection methods, including extensive industry surveys, face-to-face high-level interviews at industry conferences, stakeholder teleconferences, and in-depth interviews conducted by IBTS staff. Results from the research found the industry needs a uniform assessment method for national providers to be more efficient; the software should support both code officials and installers; most industry stakeholders would find value in a centralized software system that allows them to collect, report, and review information on in-process and completed solar installations; and mobile solutions that bridge existing knowledge gaps with inspectors and integrate with existing methodologies (such as permitting software) are of great value. The software solution developed is web-based, allowing for national access, and is built on a Google Firebase platform that can handle significant users and data. It can be used onsite or remotely, allowing for code compliance to continue despite ongoing pandemic related delays or shutdowns for local economies. The information provided by the software tool allows users to uniformly assess a system for compliance and use that aggregated data to identify training topics or create internal process designed to improving issues and reducing occurrence. This solution has multiple benefits in managing quality at time of use and promoting an increase in future safety and quality through education. Perhaps most importantly, this software increases public safety by ensuring compliance of installed systems and allows for local AHJs to remotely engage specialized and qualified solar specific expertise for oversite of the installation in their jurisdictions. Data analysis provides the quality feedback loop identifying the root cause of failure and drives installation practices to improve through training and education, resulting in systems with higher performance, greater reliability, and reduced operations and maintenance costs. With the successful completion of this project, the industry can expect reduced soft costs and increased performance and safety and will ultimately benefit from longer performing systems that cost less to operate.

14 SOLAR ENERGY↗

Space Based Solar Power

Space based solar power (SBSP) entails in-space collection of solar energy, transmission of that energy to one or more stations on Earth, conversion to electricity, and delivery to the grid or to batteries for storage. Experts in both the aerospace and energy sectors are debating the benefits of SBSP as more organizations globally begin SBSP technology development programs. We conducted a study to evaluate the potential benefits, challenges, and options for NASA to engage with growing global interest in SBSP. We performed a first order lifecycle study of two representative SBSP designs for 2 GW utility-scale power generation that, for the purposes of the study, are presumed to begin in 2050. We assumed baseline capabilities to develop, assemble, operate, maintain, and dispose of the SBSP systems are a mix of capabilities that are above, below, or comparable to capabilities demonstrated to date. We then compared the lifecycle cost of electricity and lifecycle GHG emission intensity of the SBSP designs to alternative terrestrial renewable electricity production technologies. Our findings indicate the SBSP designs may produce lifecycle GHG emissions per unit of electricity that are comparable to terrestrial alternatives, pending further studies of upper atmosphere responses to launch emissions. We find the SBSP designs are more expensive than terrestrial alternatives and may have lifecycle costs per unit of electricity that are 12-80 times higher. Though, we do find cost competitiveness may be achieved if a favorable combination of cost and capability improvements related to launch and manufacturing that are beyond the advancements assumed in the baseline assessment can be attained.

Erica Rodgers↗

Space Based Solar Power Study

Space based solar power (SBSP) entails in-space collection of solar energy, transmission of that energy to one or more stations on Earth, conversion to electricity, and delivery to the grid or to batteries for storage. Experts in both the aerospace and energy sectors are debating the benefits of SBSP as more organizations globally begin SBSP technology development programs. We conducted a study to evaluate the potential benefits, challenges, and options for NASA to engage with growing global interest in SBSP. We performed a first order lifecycle study of two representative SBSP designs for 2 GW utility-scale power generation that, for the purposes of the study, are presumed to begin in 2050. We assumed baseline capabilities to develop, assemble, operate, maintain, and dispose of the SBSP systems are a mix of capabilities that are above, below, or comparable to capabilities demonstrated to date. We then compared the lifecycle cost of electricity and lifecycle GHG emission intensity of the SBSP designs to alternative terrestrial renewable electricity production technologies. Our findings indicate the SBSP designs may produce lifecycle GHG emissions per unit of electricity that are comparable to terrestrial alternatives, pending further studies of upper atmosphere responses to launch emissions. We find the SBSP designs are more expensive than terrestrial alternatives and may have lifecycle costs per unit of electricity that are 12-80 times higher. Though, we do find cost competitiveness may be achieved if a favorable combination of cost and capability improvements related to launch and manufacturing that are beyond the advancements assumed in the baseline assessment can be attained.

solar↗

Effects of Spatial Resolution on the Simulated Dust Aerosol Lifecycle: Implications for Dust Event Magnitude and Timing in the NASA GEOS-5 AGCM

The NASA GEOS-5 atmospheric transport model simulates global aerosol distributions with an online aerosol module. GEOS-5 may be run at various horizontal spatial resolutions depending on the research application. For example, long integration climate simulations are typically run at 2 deg or 1 deg grid spacing, whereas aerosol reanalysis and forecasting applications may be performed at O.5 deg or 0.25 deg resolutions. In this study, we assess the implications of varying spatial resolution on the simulated aerosol fields, with a particular focus on dust. Dust emissions in GEOS-5 are calculated with one of two parameterizations, one based on the Goddard Chemistry, Aerosol, Radiation, and Transport (GO CART) model and another based on the Dust Entrainment and Deposition (DEAD) model. Emission fluxes are parameterized in terms of the surface wind speed, either the 10-m (GO CART) or friction (DEAD) wind speed. We consider how surface wind speeds and thus the dust emission rates are a function of the model spatial resolution. We find that spatial resolution has a significant effect on the magnitude of dust emissions, as higher resolution versions of the model have typically higher surface wind speeds. Utilizing space-borne observations from MISR, MODIS, and CALIOP, we find that simulated Aerosol Optical Thickness (AOT) distributions respond differently to spatial resolution over the African and Asian source regions, highlighting the need to regional dust emission tuning. When compared to ground-based observations from AERONET, we found improved timing of dust events with as spatial resolution was increased. In an attempt to improve the representation of the dust aerosol lifecycle at coarse resolutions, we found that incorporating the effects of sub-grid wind variability in a course resolution simulation led to improved agreement with observed AOT magnitudes, but did not impact the timing of simulated dust events.

Nowottnick, E.↗

Automated Tracking of Shallow Maritime Clouds on Geostationary Imagery to Extract Lifecycle Characteristics

Shallow moist convection is ubiquitous throughout the tropics and represents a key player in boundary layer processes. Satellites have provided many statistics on shallow clouds, such as size, structure, and geographical coverage, from static views of recurring cloud fields. But determining why certain cloud features appear and persist for different periods requires a time-evolving view of their behaviors. Geostationary satellites provide a unique opportunity to follow the time evolution of individual convective features, given their enhanced spatial and temporal sampling. A cloud-tracking tool was developed to identify properties of cloud lifecycle from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP2EX) field campaign of 2019. The mission conducted intensive sampling of shallow cumulus in the West Pacific Ocean, in tandem with Rapid Scan imagery from the Advanced Himawari Imager (AHI) on the Japan Meteorological Agency’s (JMA) Himawari-8 satellite. Shallow cumulus was segmented according to thresholds in 0.5-km visible reflectance and with blurring techniques. Despite being limited to daytime hours, the segmentations yielded the best resolution possible for capturing cloud initiation and decay. The tracking procedure is based on a computer vision package that includes Kalman filters for motion prediction, object overlap search, and the Hungarian (or Kuhn-Munkres) matching algorithm for track designation. AHI radiances available within the tracked cloud boundaries are assembled to form individual spectral histories. The resulting catalog provides thousands of cloud histories for domains measuring only a few degrees in latitude and longitude. We present an overview of the cloud-tracking tool, strategies to identify development stages from cloud tracks, and preliminary results that document cumulus lifecycle properties from satellite. The application of AHI 0.5-km reflectance has both strengths and limitations when attempting to track lifecycles of the smallest resolvable clouds. We show that by aggregating cloud tracks from a few case studies of CAMP2EX, we can discern differences in cloud lifetime and development according to ensembles selected from areas of interest. The results demonstrate an ability to quantify lifetimes and assess rates of change in cloud characteristics that are likely controlled by the surrounding environment and meteorology.

Cloud Tracking↗

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗

Advancing Organized Convection Representation in the Unified Model: Implementing and Enhancing Multiscale Coherent Structure Parameterization

To address the effect of stratiform latent heating on meso- to large-scale circulations, an enhanced implementation of the Multiscale Coherent Structure Parameterization (MCSP) is developed for the Met Office Unified Model. MCSP represents the top-heavy stratiform latent heating from under-resolved organized convection in general circulation models. We couple the MCSP with a mass-flux convection scheme (CoMorph-A) to improve storm lifecycle continuity. The improved MCSP trigger is specifically designed for mixed-phase deep convective cloud, combined with a background vertical wind shear, both known to be crucial for stratiform development. We also test a cloud top temperature dependent convective-stratiform heating partitioning, in contrast to the earlier fixed partitioning. Assessments from ensemble weather forecasts and decadal simulations demonstrate that MCSP directly reduces cloud deepening and precipitation areas by moderating mesoscale circulations. Indirectly, it amends tropical precipitation biases, notably correcting dry and wet biases over India and the Indian Ocean, respectively. Remarkably, the scheme outperforms a climate model ensemble by improving seasonal precipitation cycle predictions in these regions. The scheme also improves Madden-Julian Oscillation (MJO) spectra, achieving better alignment with observational and reanalysis data by intensifying the simulated MJO over the Indian Ocean during phases 4 to 5. However, the scheme increases precipitation overestimation over the Western Pacific. Shifting from fixed to temperature-dependent convective-stratiform partitioning reduces the Pacific precipitation overestimation and further improves the seasonal cycle in India. Spatially correlated biases highlight the necessity for advances beyond deterministic approaches to align MCSP with environmental conditions.

54 ENVIRONMENTAL SCIENCES↗

Problem Reporting System

The Problem Reporting System (PRS) is a Web application, running on two Web servers (load-balanced) and two database servers (RAID-5), which establishes a system for submission, editing, and sharing of reports to manage risk assessment of anomalies identified in NASA's flight projects. PRS consolidates diverse anomaly-reporting systems, maintains a rich database set, and incorporates a robust engine, which allows tracking of any hardware, software, or paper process by configuring an appropriate life cycle. Global and specific project administration and setup tools allow lifecycle tailoring, along with customizable controls for user, e-mail, notifications, and more. PRS is accessible via the World Wide Web for authorized user at most any location. Upon successful log-in, the user receives a customizable window, which displays time-critical 'To Do' items (anomalies requiring the user s input before the system moves the anomaly to the next phase of the lifecycle), anomalies originated by the user, anomalies the user has addressed, and custom queries that can be saved for future use. Access controls exist depending on a user's role as system administrator, project administrator, user, or developer, and then, further by association with user, project, subsystem, company, or item with provisions for business-to-business exclusions, limitations on access according to the covert or overt nature of a given project, all with multiple layers of filtration, as needed. Reporting of metrics is built in. There is a provision for proxy access (in which the user may choose to grant one or more other users to view screens and perform actions as though they were the user, during any part of a tracking life cycle - especially useful during tight build schedules and vacations to keep things moving). The system also provides users the ability to have an anomaly link to or notify other systems, including QA Inspection Reports, Safety, GIDEP (Government-Industry Data Exchange Program) Alert, Corrective Actions, and Lessons Learned. The PRS tracking engine was designed as a very extensible and scalable system, able to support additional applications, with future development possibilities already discussed, including Incident Surprise Anomalies (for anomalies occurring during Operations phases of NASA Flight projects), GIDEP and NASA Alerts, and others.

Potter, Don↗