Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

A probabilistic economic and environmental impact assessment of a cyanobacteria-based biorefinery

Microbial based biofuels represent a potential promising solution as an environmentally favorable transportation fuel. Cyanobacteria have many of the same advantages as microalgae: ability for rapid growth in otherwise non-arable regions, suitability for genetic engineering, and simple nutritional needs. Additionally, cyanobacteria can be engineered to secrete valuable co-products that can be harvested independent from the produced biomass. However, little work has been done to identify the processes and the economic and environmental impacts associated with a large-scale cyanobacteria-to-fuels facility. The present study is a concurrent techno-economic and life cycle assessment of a facility that generates fuels and methyl laurate, an oleochemical, from the cyanobacterial species Synechocystis sp. PCC 6803. Here, the biorefinery model includes all aspects of cultivation, separation of the secreted methyl laurate, biomass harvesting and fuel processing via hydrothermal liquefaction (HTL) of the dewatered biomass. The assessments leverage Monte Carlo analysis (MCA) to address uncertainty and variability inherent in the most significant input parameters, replacing them with probabilistic functions. For the facility configuration producing both fuels and the oleochemical co-product, the MCA average minimum fuel selling price (MFSP) is $\$2.47$ per decimeter (dm 3 ) or $\$9.34$ per gallon of gasoline equivalent (gge) with the corresponding average global warming potential determined to be 118 g CO 2 -eq-MJ -1 . The case producing only fuels results in an MCA average MFSP of $\$2.01$-(dm 3 ) -1 ($\$7.60$-gge -1 ) and an average environmental impact of 100 g CO 2 -eq-MJ -1 . These results are compared to static optimistic and conservative scenario analysis estimates, illustrating the over- and under-estimation of outcomes associated with non-stochastic methods. Suggested facility improvements include increases in pond productivity of both the biomass and methyl laurate oil production, as well as improvements to carbon utilization and bio-crude yield from HTL processing.

09 BIOMASS FUELS↗
DOE OSTI2025

Welch Method and Bootstrapping Applied to Subcritical Gamma Noise

We measured the prompt neutron decay constant 𝛼 of the CROCUS zero-power reactor at the Swiss Federal Institute of Technology Lausanne using cross-power spectral density (CPSD) analysis of gamma-gamma correlations from two trans-stilbene organic scintillators positioned near the reactor core. We measured critical and subcritical states, with water levels ranging from 960 mm (critical) to 800 mm (𝜌=−1.4 $ subcritical). Our analysis used the Welch method, dividing signal segments for fast Fourier transform (FFT) frequency analysis and applying bootstrapping uncertainty quantification that uses Welch-defined segments. Results demonstrated a clear increase in the measured 𝛼 as reactor reactivity decreased, distinguishing critical from subcritical conditions. At the 960-mm critical level, 𝛼 was estimated at 155.9 ± 0.7 s −1 , and for the 800-mm subcritical level, 𝛼 increased significantly to 367.3 ± 6.9 s –1 . A linear regression of subcritical states yielded a critical estimate of 154.0 ± 3.1 s –1 , aligning with the static 𝛼 estimate at critical. The bootstrapping method produced normally distributed 𝛼 estimates, confirming data consistency. The gamma CPSD 𝛼 estimates clearly distinguish reactor states and improve monitoring of zero-power reactors. The future deployment of modular and microreactors as potential candidates for noise analysis is demonstrated in CROCUS, particularly zero-power mock-ups of new designs. The improvement of noise analysis in the subcritical domain from this work will support experimental data for reactor deployment and procedure.

CROCUS↗
NASA NTRSDate not supplied

Three-Dimensional Nonequilibrium Boundary Layer Stability & Transition Analysis For Martian Entry

In this work, we apply the boundary layer stability code LASTRAC, modified to include chemical and thermal nonequilibrium capabilities, to a simulated test case based on literature, with three-dimensional effects. LASTRAC provides Parabolized Stability Equations (PSE)as well as Linear Stability Theory (LST) to predict the stability of a boundary layer and transition with semiempirical eN methods. Tests of the Mars Science Laboratory (MSL)indicated a range of laminar to transitional flow conditions. In order to reduce the weight of Thermal Protection Systems (TPS), reliable prediction of transition and an understanding of the environmental factors that contribute to transition are necessary. This work is a step towards addressing this need, including the effects of thermochemical nonequilibrium but neglecting radiation, ablation, and ionization effects. Our results indicate that an oblique first mode produces maximum N-Factors on the symmetry plane, however with N-Factors too small to explain transition. Although we are able to show nonequilibrium three-dimensional PSE results inCO2, further study with improved mean flow solutions, accounting for some of the uncertainties inherent in this analysis, or evaluation of alternative transition mechanisms is needed to explain transition in the wind tunnel cases examined here.

H L Kline↗
DOE OSTI2024

A magnetic diagnostic suite for the Pegasus-III experiment

Pegasus-III is an ultralow aspect ratio spherical tokamak providing a dedicated US experiment for comparative solenoid-free startup studies. A new magnetic diagnostic suite for equilibrium and low frequency (<200 kHz) magnetohydrodynamic mode analysis has been installed. These new diagnostics address the significant challenges of measuring magnetic field in a high noise environment with the majority constrained to fit in an 8 mm diagnostic gap on the high field side. Electrostatic switching noise generated by the 16 independent current feedback-controlled power supplies produces dV cm /dt ~ 1 kV/μs and volt level common mode noise on the magnetics. Immunity to this switching noise is accomplished through differential signal runs and signal processing, along with end-to-end electromagnetic interference shielding. The magnetic measurements are simultaneously digitized at 1 MHz and conditioned by precision 8 pole Butterworth filters with a corner frequency of 200 kHz to prevent aliasing down to the 16-bit level over the full passband. Ex-vessel calibrations of the B p coils were completed with a typical uncertainty of <0.5%. Stray toroidal field pickup from coil misalignment or positioning errors is corrected using a physics-based model. Comparisons of the corrected measurements to modeling agree to within 1.3% on average. This is within the 1.5% measurement uncertainty that a sensitivity analysis determined is needed for accurate fast boundary and equilibrium reconstruction.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Stochastic multiscale modeling for quantifying statistical and model errors with application to composite materials

This paper provides a coherent and efficient computational framework for stochastic multiscale analysis of material systems in the presence of parametric uncertainties and modeling errors. Uncertainty in those model parameters that are not deduced as upscaled quantities is attributed to an uncertainty “germ”. While such parameters can appear at any scale, they are predominant at the finest analysis scale. Additional uncertainties stemming from statistical estimation, attributed to lack of data and model error, are associated with each submodel contributing to the multiscale system. Here, a robust and efficient framework based on a generalized extended polynomial chaos expansion (gEPCE) is proposed to simultaneously propagate all these uncertainties in order to provide a probabilistic representation of specific quantities of interest (QoI). We characterize the full probability distribution of the QoI and the uncertainty in the failure probability pertaining to its tails. By combining gEPCE with kernel density estimation (KDE) and directional derivatives, we construct sensitivity measures that connect these statistical metrics of QoI to the various sources of uncertainty to assess their individual and combined impacts. An illustrative problem featuring three-point bending of a composite beam is investigated to demonstrate the presented approach.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Hyper Suprime-Cam Year 3 results: Cosmology from cosmic shear two-point correlation functions

Here, we perform a blinded cosmology analysis with cosmic shear two-point correlation functions measured from more than 25 million galaxies in the Hyper Suprime-Cam three-year shear catalog in four tomographic redshift bins ranging from 0.3 to 1.5. After conservative masking and galaxy selection, the survey covers 416 deg 2 of the northern sky with an effective galaxy number density of 15 arcmin –2 over the four redshift bins. The 2PCFs adopted for cosmology analysis are measured in the angular range; 7.1 <θ/arcmin < 56.6 for ξ + and 31.2 < θ/arcmin < 248 for ξ – , with a total signal-to-noise ratio of 26.6. We apply a conservative, wide, flat prior on the photometric redshift errors on the last two tomographic bins, and the relative magnitudes of the cosmic shear amplitude across four redshift bins allow us to calibrate the photometric redshift errors. With this flat prior on redshift errors, we find Ω m = 0.25⁢6$^{+0.056}_{–0.044}$ and S 8 ≡ σ 8 ⁢$\sqrt{Ω_{m}/0.3}$ = 0.76⁢9$^{+0.031}_{–0.034}$ (both 68% C.I.) for a flat Λ cold dark matter cosmology. We find, after unblinding, that our constraint on S 8 is consistent with the Fourier space cosmic shear and the 3 × 2 pt analyses on the same HSC dataset. We carefully study the potential systematics from astrophysical and systematic model uncertainties in our fiducial analysis using synthetic data, and report no biases (including projection bias in the posterior space) greater than 0.5σ in the estimation of S 8 . Our analysis hints that the mean redshifts of the two highest tomographic bins are higher than initially estimated. In addition, a number of consistency tests are conducted to assess the robustness of our analysis. Comparing our result with Planck-2018 cosmic microwave background observations, we find a ~2σ tension for the Λ ⁢CDM model.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1977

Space shuttle engineering and operations support: Dispersion analysis for the first orbital flight test (OFT-1) mission

A dispersion analysis considering 3—sigma (3σ) uncertainties (or perturbations) in platform, vehicle, and environmental parameters has been performed for the first orbital flight test (OFT-1) mission. The dispersion analysis is based on the nominal trajectory for the OFT-1 reference flight profile (RFP) which is described in Reference 1. The analysis has been performed to determine state vector and performance dispersions (or variations) which result from the indicated 3σ uncertainties. The dispersions are determined at major mission events and fixed times from Liftoff (time slices). The dispersion results will be used to evaluate the capability of the vehicle to perform the mission within a 3σ Level of confidence and to determine flight performance reserves. (FPR).

L.S. Snow↗
NASA NTRS1971

L-/S-band calibration error analysis.

Results of a statistical error analysis performed to determine the degree of uncertainty encountered when calibrating steerable receiving antennas with the solar calibration method. The analysis considers the propagation of precision error indices. It is shown that a worst-case one-sigma (1 sigma) uncertainty of plus or minus 0.8 dB in system noise temperature occurs for a solar calibration at L-band. Somewhat better precision can be achieved by monitoring the antenna gain-to-noise temperature ratio at a station; a worst-case uncertainty of plus or minus 0.5 dB (1 sigma) can be realized. An error analysis is made of a method to determine absolute antenna gain based upon solar flux density. The uncertainty in this type of measurement is plus or minus 0.7 dB (1 sigma) at L- and S-band frequencies.

Taylor, R. E.↗
NASA NTRS1985

A panel method study of vortex sheets with special emphasis on sheets of axisymmetric geometry

The self induced evolution of a vortex sheet was simulated by modeling the sheet using an integration of discrete elements of vorticity. Replacing small sections of a vortex sheet by flat panels of constant vorticity is found to reproduce more accurately the initial conditions for the Lagrangian simulation technique than replacement by point vortices. The flat panel method for the vortex sheet was then extended to model axisymmetric vortex sheets. The local and far field velocities induced by the axisymmetric panels were obtained using matched asymptotic analysis, and some of the uncertainties involved in other models of the axisymmetric vortex sheet have been eliminated. One important result of this analysis is the determination of the proper choice of core size for a circular vortex filament which may replace a section of an axisymmetric vortex sheet. Roll-up of both two dimensional and axisymmetric vortex sheets was computed using the panel methods developed in the report.

Sugioka, I.↗
NASA NTRS2022

Uncertainty Estimation for SMAP Level-1 Brightness Temperature Assimilation at Different Timescales

Soil Moisture Active Passive (SMAP) mission brightness temperature (T(b) ) observations are assimilated into NASA’s Catchment Land Surface Model using an Ensemble Kalman filter to update simulations of surface and root-zone soil moisture. Different time series components of the T(b) observations are assimilated including anomalies, inter-annual variations, and high frequency variations. To optimize the weights that the data assimilation (DA) puts on the observations, the ratio between the uncertainties of modeled and observed T(b) is approximated using modeled and observed soil moisture uncertainties estimated using triple collocation analysis. In a benchmark experiment, T(b) observations are assimilated using a spatially constant 4 Kelvin (K) observation uncertainty, as in the operational SMAP Level-4 algorithm. All DA experiments exhibit notable skill improvements in most regions. Improvements are largest for the inter-annual variations in the simulations of both surface and root-zone soil moisture (mean improvements in terms of Pearson correlation (-) are 0.08 and 0.06, respectively). Anomaly simulations improve similarly (0.07), and improvements in the high-frequency variations are only observed for surface soil moisture simulations (0.06). No notable difference in skill - neither improvement nor deterioration - is observed between the experiments that use optimized observation uncertainty parameters and the 4 K benchmark experiment. This may be explained by the presence of large observation operator errors, which are analytically shown to have the potential to render post-update uncertainty insensitive to inaccuracies in estimates of the Kalman gain. These results have important implications for the design of soil moisture DA systems, in particular for parameterizing model and observation uncertainties.

Hydrology↗
DOE OSTI2025

Software For Advanced Large-scale Analysis Of Magnetic Confinement For Numerical Design, Engineering & Research (salamander)

As magnetic confinement fusion energy gains traction internationally to enable abundant energy production, designing components for fusion systems is a pressing challenge. During the planned lifetime of a fusion device, components evolve in extreme environments and must withstand large, repeated thermal loads and bombardment by 14 MeV neutrons, plasma ions, and neutral particles (deuterium, tritium, and helium), corrosive conditions, etc. All these physical processes take place simultaneously, interact in intricate ways, and impose important constraints that can affect performance. Experimental data is rare and costly to obtain, making design particularly challenging. Predictive computational frameworks must be an integral part of an accelerated and cost-effective design process by modeling fusion system performance in simulated environments. To better understand component degradation and operational impacts on their performance, the Software for Advanced Large-scale Analysis of MAgnetic confinement for Numerical Design, Engineering & Research (SALAMANDER) is designed as an open-source, fully integrated, multiphysics, multiscale, NQA-1 compliant framework facilitating 3D, high-fidelity fusion system modeling. To that end, SALAMANDER is a MOOSE-based framework, and therefore leverages MOOSE upstream libraries such as PETSc and libMesh to deliver sophisticated finite element, finite volume, and nonlinear solver technology for fusion energy simulations. SALAMANDER couples MOOSE physics module capabilities—such as thermal hydraulics, heat conduction, Navier-Stokes, and thermomechanics—with tritium transport via TMAP8, neutronics via Cardinal, and nascent particle-in-cell capabilities. Direct simulation Monte Carlo methods will be used to address neutral transport near the walls. By coupling all these physics in an integrated application, SALAMANDER will enable high-fidelity modeling of irradiation levels and plasma exposure conditions of plasma facing components and their impact on heat and tritium distributions, as well as the resulting mechanical constraints experienced by the plasma facing components and performance of blanket systems. Furthermore, SALAMANDER will be particularly suited for engineering studies thanks to the stochastic tool module readily available in MOOSE, allowing for extended uncertainty quantification and risk analysis studies. It is also able to use computer-aided design (CAD) meshes to model complex geometries, which is indispensable for fusion systems. SALAMANDER therefore supports design, safety, engineering, and research projects for magnetic confinement fusion systems

Simon, Pierre-Clement [Idaho National Laboratory (↗
DOE OSTI2025

Reproducibility of Radiokrypton in Deep Desert Aquifers: Insights from a Decade of Research

Great technical advances have been achieved since the first atom-trap trace analysis (ATTA) -based radiokrypton application in Egypt, where 1 Myr old groundwater was discovered. Beyond advances in ATTA measurement capabilities, including reduction in sample size, analysis duration, and analytical uncertainty, major progress has been achieved over the past two decades in the sample collection and preparation techniques. These advances paved the expansion of ATTA-based noble gas applications to many other aquifers worldwide, illuminating the nature and flow pattern of deep groundwater systems. While the potential of this new analytical technique for old groundwater dating is well recognized, another important aspect yet to be examined is the reproducibility of radiokrypton in aquifers over time, i.e., how representative is a discrete groundwater sample, collected at a specific time and location, for the natural groundwater system? The likelihood of a negative answer is increased by flow-field disturbance in aquifers following massive groundwater abstraction. Here, in this work, we present repeated 81 Kr sampling and measurements in twenty-one sites over Israel, mostly of deep (up to 1 km) wells tapping confined aquifers in the arid to hyperarid Negev desert. The results demonstrate that radiokrypton measurements are indeed reproducible, even in cases where samples were collected as long as nine years apart and from highly productive (∼1 Mm 3 /yr order) pumping wells. Furthermore, many of the repeated measurements in this study (17 out of the 21 sites) were conducted with different ATTA Instruments in two different laboratories using slightly different sampling, preparation, and analysis techniques, yet with an overall good agreement. The consistency in the ATTA-based 81 Kr-dating results over time highlights the robustness of this state-of-the-art technique as a tool to unravel groundwater flow patterns and encourages further applications to many other yet-to-be-explored deep aquifers.

atom-trap trace analysis↗
DOE OSTI2024

ECAR-7932 Rev 0 Large Eddy Simulation of MARVEL Reactor Core Subchannel to Evaluate Model Uncertainty of Reynolds-Averaged Navier-Stokes Equation Based Computational Fluid Dynamics Analysis

In the previous work (ECAR-7210), the peak cladding temperature of the MARVEL microreactor has been evaluated by steady-state Reynolds-Averaged Navier-Stokes (RANS) based computational fluid dynamics (CFD) simulations. Although numerical uncertainties of RANS-based CFD simulations has been assessed in ECAR-7210, the model uncertainty of RANS turbulence models must be investigated to resolve the issues related to inaccurate prediction of turbulent heat flux and flow pulsation in a tight lattice rod bundle using the steady-state RANS simulations. Consequently, this ECAR conducted a high-fidelity CFD analysis utilizing Large Eddy Simulation (LES) to generate reference data and investigated the model uncertainty of RANS-based CFD simulations.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
NASA NTRSDate not supplied

Synergy of Satellite Radiation, Precipitation, and Other Meteorological Variable Observations for Global Mean Sea Surface Turbulent Heat Flux Estimation

Sea surface turbulent heat flux is one of the key components in global freshwater and energy balances and plays an important role in atmospheric dynamics, thermodynamics and general circulation. This turbulent heat flux is dominantly decided by sea surface latent heat release with some contribution from sensible heat exchange. The flux and its anomaly could significantly affect ocean heat storage and ocean circulation. They are part of and have great impacts on climate variability. Though the turbulent heat flux is extremely important for the climate and weather systems, only very limited ship and buoy observations of the flux are available over open oceans. There are no global, operational, direct measurements of this crucial meteorological variable. Global estimates are, basically, indirectly calculated from bulk turbulent flux parameterization with a combination of satellite column water vapor, sea surface water temperature, and wind speed observations. Critical parameters such as sea surface air temperature and humidity are estimated from empirical relations of theses variables with the water vapor and sea surface water temperature, respectively. Lacking accurate knowledge on surface air temperature and humidity, uncertainties in the parameterization and potential changes in the non-linear turbulent processes with long-term climate variations could cause large errors in estimated long-term turbulent fluxes from the indirect method as shown in current global sea surface turbulent flux datasets. This study uses synergized data of satellite global radiation, precipitation, and other meteorological variable observations to estimate sea surface turbulent heat fluxes. The radiation observations are made by the satellite Clouds and the Earth’s Radiant Energy System (CERES) sensors, while the global precipitation data is from NASA’s satellite Global Precipitation Climatology Project (GPCP). Other data includes satellite sea surface water temperature and wind speed observations. These datasets are obtained from a wide range of space sensors from passive to active instruments and from visible and near infrared to thermal infrared and microwave spectral sounders. One significant feature of these datasets is that they have multi-decades long climate records. Top-of-atmosphere (TOA) radiation and its anomaly represents the net heat energy input to the climate system, and the oceanic precipitation and ocean-land moisture transport can be used to quantify sea surface latent heat release. Based on the synergized datasets and the principle of global water and energy balances, global mean turbulent heat fluxes are estimated. The turbulent heat anomalies for the first two decades of the 21st century are, then, obtained mainly from global CERES radiation and GPCP precipitation anomalies, along with CERES derived ocean-land heat transports. Analysis indicates that the uncertainties in the estimated turbulent flux anomalies may be reduced considerably. The results suggest a strong needs in synchronized and synergized observations of atmospheric radiation, precipitation, and oceanic meteorological variables for long-term climate studies.

Bing Lin↗
DOE OSTI2024

Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations

Abstract Large‐scale discrete fracture network (DFN) simulators are standard fare for studies involving the sub‐surface transport of particles since direct observation of real world underground fracture networks is generally infeasible. While these simulators have successfully been used in several engineering applications, estimates of output quantities of interest (QoI) — such as breakthrough time of particles reaching the edge of the system — suffer from two distinct types of uncertainty. A run of a DFN simulator requires several parameters to be set that dictate the placement and size of fractures, the density of fractures, and the overall permeability of the system; uncertainty on the proper parameters will lead to uncertainty in the QoI, called epistemic uncertainty. Furthermore, since these input settings to DFN simulators control the stochastic processes which place fractures and govern flow, understanding how this randomness affects the QoI requires several runs of the simulator at distinct random seeds. The uncertainty in the QoI attributed to different realizations (i.e., different seeds) of the same random process (i.e., identical input parameters) leads to a second type of uncertainty, called aleatoric uncertainty. In this paper, we perform a Sensitivity Analysis, which directly attributes the uncertainty observed in the QoI to the epistemic uncertainty from each input parameter and to the aleatoric uncertainty. Beyond the specific takeaways on which input variables influence uncertainty in the QoI the most, a major contribution of this paper is the introduction of a statistically rigorous workflow for characterizing the uncertainty in DFN flow simulations that exhibit heteroskedasticity.

58 GEOSCIENCES↗
NASA NTRS2021

Challenges to Aboveground Biomass Prediction from Waveform Lidar

Accurate accounting of aboveground biomass density (AGBD) is crucial for carbon cycle, biodiversity, and climate change science. The Global Ecosystem Dynamics Investigation (GEDI), which maps global AGBD from waveform lidar, is the first of a new generation of Earth observation missions designed to improve carbon accounting. This paper explores the possibility that lidar waveforms may not be unique to AGBD—that forest stands with different AGBD may produce highly similar waveforms—and we hypothesize that non-uniqueness may contribute to the large uncertainties in AGBD predictions. Our analysis integrates simulated GEDI waveforms from 428 in situ stem maps with output from an individual-based forest gap model, which we use to generate a database of potential forest stands and simulate GEDI waveforms from those stands. We use this database to predict the AGBD of the 428 in situ stem maps via two different methods: a linear regression from waveform metrics, and a waveform-matching approach that accounts for waveform-AGBD non-uniqueness. We find that some in situ waveforms are more unique to AGBD than others, which notably impacts AGBD prediction uncertainty (7–411 Mg ha−1, average of 167 Mg ha−1). We also find that forest structure complexity may influence the non-uniqueness effect; stands with low structural complexity are more unique to AGBD than more mature stands with multiple cohorts and canopy layers. These findings suggest that the non-uniqueness phenomena may be introduced by the measuring characteristics of waveform lidar in combination with how forest structure manifests at small scales, and we discuss how this complexity may complicate uncertainty estimation in AGBD prediction. This analysis suggests a limit to the accuracy and precision of AGBD predictions from lidar waveforms seen in empirical studies, and underscores the need for further exploration of the relationships between lidar remote sensing measurements, forest structure, and AGBD.

GEDI↗
DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17–18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Methods for R&D Portfolio Analysis and Evaluation (Workshop Report)

The Workshop on Methods for R&D Portfolio Analysis and Evaluation convened on 17-18 July 2019 at the National Renewable Energy Laboratory in Golden, Colorado, and examined strengths and weaknesses of the various methodologies applicable to R&D portfolio modeling, analysis, and decision support, given pragmatic constraints such as data availability, uncertainties in estimating the impact of R&D spending, and practical operational overheads. Participants employed their deep expertise in approaches such as stochastic optimization, real options, Monte-Carlo analysis, Bayesian networks, decision theory, complex systems analysis, deep uncertainty, and technology-evolution modeling to critique the initial example models developed by the project’s core team and to conduct thought experiments grounded in real-life technology models, progress data, expert elicitation, and portfolio information. This engagement of participants’ methodological expertise with the practical requirements of real-life portfolio decision support yielded ideas for improved approaches, alternative methodological hypotheses, and hybridization of methodologies that are well-grounded theoretically, computationally sound, and realistically executable given data availability and other practical constraints.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗