Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Public water supply infrastructure extensification and diversification in surface waters is insufficient to meet future demands in Texas

The data were developed to evaluate the capacity of existing and potential new surface water supply infrastructure to meet projected public water demands across districts in Texas under multiple future socioeconomic and climate scenarios. The database integrates hydrologic, water quality, infrastructure, energy, cost, demographic, and demand-projection information for candidate surface water supply locations. Candidate sites include stream reaches, waterbodies, reservoir surplus locations, and potential new reservoir sites. Water availability is characterized using historical and projected flow conditions, while site suitability is evaluated using five indicators: Water Availability Index (WAI), Water Quality Index (WQI), Energy Requirement Index (ERI), Water Treatment Cost (WTC), and Water Infrastructure Cost (WIC). The datasets include statewide candidate-site information, district-level demand projections under Shared Socioeconomic Pathways (SSPs), runoff-based allocation constraints, climate-stress metrics, and optimization outputs evaluating alternative infrastructure planning strategies. Optimization results compare Business-as-Usual (BAU) and All Surface Water (AllSW) demand-management approaches under both scaled and fixed cost-cap strategies. Associated validation datasets provide district-level feasibility assessments, infrastructure selection outcomes, cost-cap utilization, demand satisfaction metrics, and constraint diagnostics. Additional datasets quantify projected changes in storage and flow conditions as well as water availability stress for both existing and newly selected intake locations under the SSP5 scenario for mid-century and late-century climate conditions. Together, these datasets support assessment of the extent to which surface-water infrastructure expansion and diversification strategies can satisfy future public water demands while accounting for hydrologic, economic, and planning constraints across Texas. Dataset(s) Description Dataset_preoptimization.xlsx Comprehensive pre-optimization dataset containing candidate water-supply sites and associated hydrologic, water-quality, infrastructure, climate, demographic, runoff, and demand-projection variables used as inputs to the optimization analyses. Includes variable descriptions and the full statewide candidate-site database. District_level_site_selection.zip - Compressed archive containing all SSP-specific district-level optimization result files MESIO_ssp1_results.xlsx District-level site selection results for SSP1 (MESIO). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. MESID_ssp2_results.xlsx District-level site selection results for SSP2 (MESID). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. LCMRD_ssp3_results.xlsx District-level site selection results for SSP3 (LCMRD). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. IRDev-Low_ssp4l_results.xlsx District-level site selection results for SSP4-Low (IRDev-Low). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. IRDev-High_ssp4h_results.xlsx District-level site selection results for SSP4-High (IRDev-High). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. RSIM_ssp5_results.xlsx District-level site selection results for SSP5 (RSIM). Includes variable descriptions, BAU and AllSW site-selection results under scaled and fixed cost strategies, and district-level validation diagnostics. tx_hydrological_stress.xlsx Hydrological stress dataset for existing and newly selected intake locations. Includes projected mid-century and late-century changes, gain/loss classifications, planning strategy information, and accompanying variable descriptions. Also includes water-stress metrics derived from historical and projected low-flow conditions.

Okoye, Perpetua I. (ORCID:0000000215545033)↗
NASA NTRS2004

Improvement of the TOPEX and Jason Orbit Time Series: Precision Orbit Determination, Calibration, Validation and Improvement Through the Combined Reduction and Analysis of GPS, SLR, DORIS and Altimeter Data

Orbit error is a major component in the overall error budget of all altimeter satellite missions. Jason-I is no exception and a 1 cm radial orbit accuracy goal has been set, which represents a factor of two improvement over what is currently being achieved for TOPEX/Poseidon (TP). Our current analysis suggests this goal has been met and even improved upon, but the challenge is to be able to continually achieve this high accuracy, verify the performance and characterize and quantify the remaining errors over the lifetime of the mission. The computation, verification and error characterization of such high accuracy orbits requires the reduction and analysis of all available tracking data (GPS, SLR, DORIS and altimeter). Current analysis also indicates the history of TP orbits can be further improved employing new solution strategies developed and tested on Jason-I. Our research focuses on the calibration, validation and improvement of orbit accuracies using all available tracking data including altimetry. We will compute and distribute well centered Jason orbits with an accuracy of better than 1-cm in the radial component. In addition to the orbits themselves, a characterization of the orbit error will be distributed and accumulated as a time series of orbit performance metrics to track anomalies and trends. The long time series of orbit error characterization will enable a better understanding of the remaining orbit errors and its impact on the altimeter data analysis. As part of this research effort we are also significantly improving the current level of TP orbit accuracy, re-computing new high-accuracy TP orbits from the beginning of the TP mission and continuing into the future (as long as TP is healthy). Our funded research effort will result in a complete and consistent time series of improved orbits for both TP and Jason, significantly benefiting the long time series of altimeter data analysis and the TP/Jason dual mission. The resultant high accuracy orbits and the characterization of their error will allow further improvements to the accuracy and overall quality of the altimeter measurement time series making possible further strides in radar altimeter remote sensing.

Luthcke, Scott B.↗
NASA NTRS2006

Integrated Modeling of Advanced Opto-Mechanical Systems

The design of optical hardware for space applications is particularly challenging when developing high performance, novel systems that have no precedent. Integrated modeling and analysis of such opto-mechanical systems seeks to describe the end-to-end performance of the hardware using mission-relevant metrics. This multidisciplinary analysis might start with thermal disturbances from observation maneuvers, compute the system temperatures, compute the distorted positions and shapes of the hardware and compute the resulting optical performance. Dynamic disturbances such as reaction wheel imbalance or inertia imbalance of optical delay lines might be applied to a structural dynamic model and used in a guidance and control analysis. Mission-relevant science metrics might include wavefront quality, pointing error or imaging stability. Assembling a tool chain that can be both nimble and effective when scaled to the high fidelity models of detail design has been challenging. An integrated thermal, mechanical and optical analysis capability suitable for detail design has been developed and verified through experimental measurement. This capability was used in the design of flight-like breadboard hardware and development of a test apparatus that established both the level of performance of the hardware and the validity of the analysis. The analysis includes prediction of the thermal environment of the test chamber, detailed temperature distributions on the breadboard hardware, fine scale deformations of the optical elements, and computation of the wavefront quality using geometric optics. A battery of tests were conducted to assess the experiment data acquisition, measurement and control system and to establish the performance of the hardware design and accuracy of the integrated modeling. Thermal loads that represent operational observing maneuvers were imposed and the hardware optical performance was measured and compared to analytical predictions.

optomechanical analysis↗
DOE OSTI2023

Techno-Economic Case Study: Low-Temperature Conversion Performance Based on Isolated Anatomical Fractions of Corn Stover

This report summarizes analysis conducted to support a case study under the Feedstock-Conversion Interface Consortium (FCIC) focused on techno-economic analysis (TEA) modeling to quantify the yield and cost ramifications for processing isolated anatomical fractions of corn stover through a low-temperature conversion (biochemical pathway) biorefinery. It is hypothesized that different individual anatomical fractions of corn stover vary in composition and recalcitrance, such that processing each fraction on its own e.g. through dedicated campaigns may enable economic benefits relative to processing the whole stover material. To investigate this concept, we worked with FCIC researchers to obtain data on compositional analysis, as well as processing conditions and yields, for conversion of whole corn stover plus three individual anatomical fractions (cobs, husks, and stalks) across key steps of the biorefinery conversion process within FCIC research scope, namely pretreatment and enzymatic hydrolysis. After running the data through the TEA models, fractionated cobs and husks achieved higher fuel yields and lower minimum fuel selling prices than whole corn stover, but stalks fared worse than whole stover on both metrics. The most direct takeaway from this assessment is that a biorefinery would stand to benefit economically from maximizing the use of cob and husk fractions while avoiding or minimizing the use of stalks, though recognizing practical constraints with this approach in maintaining an equivalent processing capacity (fixed at 2,000 dry metric tonne per day in all cases).

09 BIOMASS FUELS↗
DOE OSTI2022

Production Agency Quality Assurance Management Execution Strategy [Thesis]

There are multiple federal directives that Los Alamos National Laboratory (LANL) must follow for the proper implementation of quality assurance, strategic planning, and execution of manufacturing and surveillance operations. Recent assessments identified that manufacturing in all processing areas is dynamic due to influencing scope changes, design modifications, funding adjustments, and staff attrition. In response, this project was started to develop a comprehensive PAQ execution strategy to support the success of LANL’s manufacturing mission. This project’s method for developing an updated architecture was to create an integrated, flexible, reliable, and agile strategic process. The execution plan has five deliverables: 1) an integrated schedule view of PAQ work scope, 2) a resource management plan that aligns with the required scope, 3) a metrics monitoring dashboard, 4) a project management plan for sustaining NAP 401.1A implementation, and 5) a risk management plan. The research design is a mixed-method approach focused on data collection for each deliverable. The methodology entails qualitative and quantitative research, metrics monitoring, data analysis, and the creation of a dashboard. The qualitative methods used include literature reviews and interviews. The quantitative methods include resource, financial, schedule and survey data analysis. Preliminary and final results were peer reviewed by subject matter experts both within the ALDWP organization and deployed support.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Interlaced Characterization and Calibration (ICC) for Improved Computational Simulation Credibility

Accurate material characterization and model calibration are pivotal for simulations used for high-consequence engineering decisions. Current characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data is collected for a specific model of interest, (3) provide only mean parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work developed a new paradigm—coined Interlaced Characterization and Calibration (ICC)—which drives forward the state-of-the-art in model calibration by bringing together recent advancements into one improved workflow. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) provides uncertainty metrics on the calibrated model parameters, and (4) incorporates these advances into a quasi real-time feedback loop. The ICC framework was validated synthetically with both low-fidelity and high-fidelity simulations paired with several different elastoplastic material models, and was also demonstrated experimentally with an aluminum 6061 cruciform exemplar specimen. Results showed that the ICC framework—in which Bayesian optimal experimental design actively guided the experiment— resulted in calibrations with similar or better accuracy than predetermined experiments based on subject matter expertise. Moreover, the ICC framework produced a complete model calibration— with quantified uncertainties on model parameters—in 1 week, a 5 - 10× increase in efficiency over traditional approaches. Thus, the ICC paradigm improves both the calibration process and quality, by (1) improving efficiency, which increases agility of solid mechanics modeling and enables utilization of computational simulation (CompSim) at earlier stages of the design cycle and (2) providing quantified, and in some cases reduced, parameter uncertainties, which increases confidence in model predictions and supports credible decision making.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

The Dynamic Networks Experiments: Virtual Experiments to Quantify Gains in Nuclear Explosion Monitoring

We describe an ongoing series of virtual experiments conducted collaboratively by four United States National Laboratories: Sandia National Laboratories, Los Alamos National Laboratory, Lawrence Livermore National Laboratory, and Pacific Northwest National Laboratory. These Dynamic Network Experiments (DNEs) provide an experimental framework to evaluate the potential impact of new research tools on nuclear explosion monitoring. The second DNE (DNE2), completed in 2024, exploited waveform data (seismic, infrasound, and electromagnetic) that was recorded by multi-modal sensors within and near the Nevada National Security Site and synthetic radionuclide signatures over multiple time periods. During the execution of DNE2, we processed and analyzed data through a multi-stage event processing pipeline that ingested raw data, performed quality control, detected signals, built events from these signals, located these events, and characterized the events’ source types and sizes. For each stage and over the entire event processing pipeline, we evaluated performance changes by comparing the performance of new data processing methods, models, and algorithms against a baseline. We also performed an additional execution phase to assess event processing pipeline function, speed, and efficiency against that of an expert analyst, including computational and manual efforts. Finally, we assessed the impact and effort of modern computing infrastructure on the monitoring pipeline. This paper describes key elements of the DNEs, from formulation through execution, as demonstrated in DNE2. The DNEs introduce several novel concepts to quantitatively measure the potential impact of new methods on explosion monitoring, including the collaborative design of multi-modal datasets, performance and logistical metrics, and integrated analyses.

42 ENGINEERING↗
DOE OSTI2015

SU-E-P-22: AAPM Task Group 263 Tackling Standardization of Nomenclature for Radiation Therapy

Purpose: There is growing recognition of need for increased clarity and consistency in the nomenclatures used for body and organ structures, DVH metrics, toxicity, dose and volume units, etc. Standardization has multiple benefits; e.g. facilitating data collection for clinical trials, enabling the pooling of data between institutions, making transfers (i.e. hand-offs) between centers safer, and enabling vendors to define “default” settings. Towards this goal, the American Association of Physicists in Medicine (AAPM) formed a task group (TG263) in July of 2014, operating under the Work Group on Clinical Trials to develop consensus statements. Guiding principles derived from the investigation and example nomenclatures will be presented for public feedback. Methods: We formed a multi-institutional and multi-vendor collaborative group of 39 physicists, physicians and others involved in clinical use and electronic transfer of information. Members include individuals from IROC, NRG, IHE-RO, DICOM WG-7, ASTRO and EORTC groups with overlapping interests to maximize the quality of the consensus and increase the likelihood of adoption. Surveys of group and NRG members were used to define current nomenclatures and requirements. Technical requirements of vendor systems and the proposed DICOM standards were examined. Results: There is a marked degree of inter and intra institutional variation in current approaches, resulting from inter-vendor differences in capabilities, clinic specific conceptualizations and inconsistencies. Using a consensus approach, the group defined optimal formats for the naming of targets and normal structures. A formal objective assessment of 13 existing clinically-used software packages show that all had capabilities to accommodate these recommended nomenclatures. Conclusions: A multi-stakeholder effort is making significant steps forward in developing a standard nomenclature that will work across platforms. Our current working list includes > 550 structures. Outreach efforts are ongoing to ensure broader participation in evaluating and testing the principles as they are developed by TG263.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2017

It's All Relative: A Validation of Radiation Quality Comparison Metrics

The difference between high-LET and low-LET radiation is quantified by a measure called relative biological effectiveness (RBE). RBE is defined as the ratio of the dose of a reference radiation to that of a test radiation to achieve the same effect level, and thus, is described either as an iso-effector dose-to-dose ratio. A single dose point is not sufficient to calculate an RBE value; therefore, studies with only one dose point usually calculate an effect-to-effect ratio. While not formally used in radiation protection, these iso-dose values may still be informative. Shuryak, et al 2017 investigated the use of an iso-dose metric termed "radiation effects ratio" (RER) and used both RBE and RER to estimate high-LET risks. To apply RBE or RER to risk prediction, the selected metric must be uniquely defined. That is, the calculated value must be consistent within a model given a constant set of constraints and assumptions, regardless of how effects are defined using statistical transformations from raw endpoint data. We first test the RBE and the RER to determine whether they are uniquely defined using transformations applied to raw data. Then, we test whether both metrics can predict heavy ion response data after simulated effect size scaling between human populations or when converting animal to human endpoints.

Chappell, Lori J.↗
DOE OSTI2020

An international laboratory comparison of dissolved organic matter composition by high resolution mass spectrometry: Are we getting the same answer?

Since the first detailed compositional analysis of dissolved organic matter (DOM) in 1995, high resolution mass spectrometry (HRMS) has become a vital tool for DOM characterization. While the upward trend in HRMS for molecular level analysis of DOM continues, so do the challenges of data comparison and interpretation between laboratories operating instruments of differing performance and user operating conditions. It is therefore essential that the community establishes whether data and trends can be compared robustly between research groups. To this end, 4 identically prepared DOM samples were each studied by 16 laboratories, representing 17 commercially-purchased instruments located across 8 countries, using positive- and negative-mode electrospray ionization (ESI) HRMS analysis. Despite the widely reported sensitivity of ESI experiments to sample matrix, preparation, ion source operation and instrument tuning parameters, the instruments used in this study showed relatively low variability between results for the same samples, particularly H/C and AI metrics. The variation in O/C and m/z metrics was relatively higher, although z-score graphs and %BCD demonstrated that the relative difference in general chemical composition between samples was the same for each instrument included in the study. As such, these metrics can be used for fingerprinting of DOM samples and as a benchmark for quality control in participating laboratories, with future strides in environmental science building upon these efforts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Algal Biomass Production via Open Pond Algae Farm Cultivation: 2022 State of Technology and Future Research

The annual State of Technology (SOT) assessment is an essential activity for platform research conducted under the Bioenergy Technologies Office (BETO). It allows for the impact of research progress (both directly achieved in-house at the National Renewable Energy Laboratory [NREL] and furnished by partner organizations) to be quantified in terms of economic improvements in the overall biofuel production process for a particular biomass processing pathway, whether based on terrestrial or algal biomass feedstocks. As such, initial benchmarks can be established for currently demonstrated performance, and progress can be tracked toward out-year goals to ultimately demonstrate economically viable biofuel technologies. NREL's algae SOT benchmarking efforts focus both on front-end algal biomass production and separately on back-end conversion to fuels through NREL's "combined algae processing" (CAP) pathway. The production model is based on outdoor long-term cultivation data, enabled by comprehensive algal biomass production trials conducted under the Development of Integrated Screening, Cultivar Optimization, and Verification Research (DISCOVR) consortium efforts, driven by data furnished by Arizona State University (ASU) at the Arizona Center for Algae Technology and Innovation (AzCATI) testbed site. The CAP model is based on experimental efforts conducted primarily under NREL research and development projects. This report focuses on front-end algal biomass production, documenting the pertinent algal biomass cultivation parameters that were input to the NREL open pond algae farm model. Through partnerships under DISCOVR, collaborators at ASU furnished details on cultivation performance metrics including biomass productivity and harvest densities for recent growth trials done at the AzCATI site. The resulting biomass productivity was calculated at 18.5 g/m2/day (ash-free dry weight [AFDW], annual average) for seasonal cultivation of Picochlorum celeri, Tetraselmis striata LANL1001, and Monoraphidium minutum 26B-AM biomass strains at the ASU site. Picochlorum celeri achieved the best productivity from May to September, with Monoraphidium minutum 26B-AM being used in October, November, March, and April, and Tetraselmis striata employed during winter months (December through February). Beyond the standard SOT models, in Appendix C of this report we also present an industry case study evaluating several scenarios reflective of outdoor cultivation data furnished by an industry collaborator. This case study provides a supplementary datapoint on work being performed elsewhere achieving comparable cultivation productivity with more favorable compositional quality, producing biomass enriched in lipids as may be more optimal for conversion upgrading to fuels and products.

09 BIOMASS FUELS↗
DOE OSTI2024

Assessing Resilience in Lane Detection Methods: Infrastructure-Based Sensors and Traditional Approaches for Autonomous Vehicles

Traditional autonomous vehicle perception subsystems that use onboard sensors have the drawbacks of high computational load and data duplication. Infrastructure-based sensors, which can provide high quality information without the computational burden and data duplication, are an alternative to traditional autonomous vehicle perception subsystems. However, these technologies are still in the early stages of development and have not been extensively evaluated for lane detection system performance. Therefore, there is a lack of quantitative data on their performance relative to traditional perception methods, especially during hazardous scenarios, such as lane line occlusion, sensor failure, and environmental obstructions. We address this need by evaluating the influence of hazards on the resilience of three different lane detection methods in simulation: (1) traditional camera detection using a U-Net algorithm, (2) radar detections using infrastructure-based radar retro-reflectors (RRs), and (3) direct communication of lane line information using chip-enabled raised pavement markers (CERPMs). The performance of each of these methods is assessed using resilience engineering metrics by simulating the individual methods for each sensor technology’s response to related hazards in the CARLA simulator. Using simulation techniques to replicate these methods and hazards acquires extensive datasets without lengthy time investments. Specifically, the resilience triangle was used to quantitatively measure the resilience of the lane detection system to obtain unique insights into each of the three lane detection methods; notably the infrastructure-based CERPMs and RRs had high resistance to hazards and were not as easily affected as the vision-based U-Net. However, while U-Net was able to recover the fastest from the disruption as compared to the other two methods, it also had the most performance loss. Overall, this study demonstrates that while infrastructure-based lane keeping technologies are still in early development, they have great potential as alternatives to traditional ones.

Patil, Pritesh↗
DOE OSTI2018

Spatiotemporal interpolation of air pollutants in the Greater Cairo and the Delta, Egypt

Highlights: • Data from network of monitoring stations in Egypt are used for studying SO{sub 2}, NO{sub 2}, and PM{sub 10.} • Trans-Gaussian Spatiotemporal kriging is used as a spatiotemporal interpolation method. • The whole area under study is suffering from high values of PM{sub 10} throughout 2015. • For NO{sub 2} and SO{sub 2}, the highest value is noticed in February. • Concerns must be given to the monitoring network to improve the prediction precision. This paper analyses the spatiotemporal variability of air pollutants in Egypt using monthly averages from the air quality monitoring network from 2011 to 2015. Particulate Matters (PM{sub 10}) Nitrogen Dioxide (NO{sub 2}) and Sulfur Dioxide (SO{sub 2}), measured by the monitoring stations network are studied. A log transformation is applied for the three pollutants to achieve normality. The sum-metric function is utilized for modelling the spatiotemporal variogram as it gave the smallest Mean Squared Error (MSE) compared to other forms namely separable, metric, and product sum models. Therefore, employing the gstat package in R together with the trans-Gaussian spatiotemporal kriging, the maps are generated for the interpolated surfaces for the monthly averages of 2015 and the corresponding standard error values. These maps will help the decision maker to understand and visualize the spatial and temporal variability of the measured pollutants and hence undertake the necessary policies and decisions. The results show that the down town area has the highest pollutants levels. As concerns the temporal dimension, the highest values are depicted during the month of February as compared to the rest of the year. Furthermore, Egypt is suffering from a serious PM{sub 10} problem for the area and period under study that extremely exceed the WHO and Egyptian guidelines.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2016

Temporal regularization of ultrasound-based liver motion estimation for image-guided radiation therapy

Purpose: Ultrasound-based motion estimation is an expanding subfield of image-guided radiation therapy. Although ultrasound can detect tissue motion that is a fraction of a millimeter, its accuracy is variable. For controlling linear accelerator tracking and gating, ultrasound motion estimates must remain highly accurate throughout the imaging sequence. This study presents a temporal regularization method for correlation-based template matching which aims to improve the accuracy of motion estimates. Methods: Liver ultrasound sequences (15–23 Hz imaging rate, 2.5–5.5 min length) from ten healthy volunteers under free breathing were used. Anatomical features (blood vessels) in each sequence were manually annotated for comparison with normalized cross-correlation based template matching. Five sequences from a Siemens Acuson™ scanner were used for algorithm development (training set). Results from incremental tracking (IT) were compared with a temporal regularization method, which included a highly specific similarity metric and state observer, known as the α–β filter/similarity threshold (ABST). A further five sequences from an Elekta Clarity™ system were used for validation, without alteration of the tracking algorithm (validation set). Results: Overall, the ABST method produced marked improvements in vessel tracking accuracy. For the training set, the mean and 95th percentile (95%) errors (defined as the difference from manual annotations) were 1.6 and 1.4 mm, respectively (compared to 6.2 and 9.1 mm, respectively, for IT). For each sequence, the use of the state observer leads to improvement in the 95% error. For the validation set, the mean and 95% errors for the ABST method were 0.8 and 1.5 mm, respectively. Conclusions: Ultrasound-based motion estimation has potential to monitor liver translation over long time periods with high accuracy. Nonrigid motion (strain) and the quality of the ultrasound data are likely to have an impact on tracking performance. A future study will investigate spatial uniformity of motion and its effect on the motion estimation errors.

61 RADIATION PROTECTION AND DOSIMETRY↗
NASA NTRS2013

Enhanced Contact Graph Routing (ECGR) MACHETE Simulation Model

Contact Graph Routing (CGR) for Delay/Disruption Tolerant Networking (DTN) space-based networks makes use of the predictable nature of node contacts to make real-time routing decisions given unpredictable traffic patterns. The contact graph will have been disseminated to all nodes before the start of route computation. CGR was designed for space-based networking environments where future contact plans are known or are independently computable (e.g., using known orbital dynamics). For each data item (known as a bundle in DTN), a node independently performs route selection by examining possible paths to the destination. Route computation could conceivably run thousands of times a second, so computational load is important. This work refers to the simulation software model of Enhanced Contact Graph Routing (ECGR) for DTN Bundle Protocol in JPL's MACHETE simulation tool. The simulation model was used for performance analysis of CGR and led to several performance enhancements. The simulation model was used to demonstrate the improvements of ECGR over CGR as well as other routing methods in space network scenarios. ECGR moved to using earliest arrival time because it is a global monotonically increasing metric that guarantees the safety properties needed for the solution's correctness since route re-computation occurs at each node to accommodate unpredicted changes (e.g., traffic pattern, link quality). Furthermore, using earliest arrival time enabled the use of the standard Dijkstra algorithm for path selection. The Dijkstra algorithm for path selection has a well-known inexpensive computational cost. These enhancements have been integrated into the open source CGR implementation. The ECGR model is also useful for route metric experimentation and comparisons with other DTN routing protocols particularly when combined with MACHETE's space networking models and Delay Tolerant Link State Routing (DTLSR) model.

Segui, John S.↗
NASA NTRS2017

Novel Estimation of Pilot Performance Characteristics

Two mechanisms internal to the pilot that affect performance during a tracking task are: 1) Pilot equalization (i.e. lead/lag); and 2) Pilot gain (i.e. sensitivity to the error signal). For some applications McRuer's Crossover Model can be used to anticipate what equalization will be employed to control a vehicle's dynamics. McRuer also established approximate time delays associated with different types of equalization - the more cognitive processing that is required due to equalization difficulty, the larger the time delay. However, the Crossover Model does not predict what the pilot gain will be. A nonlinear pilot control technique, observed and coined by the authors as 'amplitude clipping', is shown to improve stability, performance, and reduce workload when employed with vehicle dynamics that require high lead compensation by the pilot. Combining linear and nonlinear methods a novel approach is used to measure the pilot control parameters when amplitude clipping is present, allowing precise measurement in real time of key pilot control parameters. Based on the results of an experiment which was designed to probe workload primary drivers, a method is developed that estimates pilot spare capacity from readily observable measures and is tested for generality using multi-axis flight data. This paper documents the initial steps to developing a novel, simple objective metric for assessing pilot workload and its variation over time across a wide variety of tasks. Additionally, it offers a tangible, easily implementable methodology for anticipating a pilot's operating parameters and workload, and an effective design tool. The model shows promise in being able to precisely predict the actual pilot settings and workload, and observed tolerance of pilot parameter variation over the course of operation. Finally, an approach is proposed for generating Cooper-Harper ratings based on the workload and parameter estimation methodology.

Human pilot models↗
DOE OSTI2016

TU-D-201-04: Veracity of Data Elements in Radiation Oncology Incident Learning Systems

Purpose: Incident learning systems encompass volumes, varieties, values, and velocities of underlying data elements consistent with the V’s of big data. Veracity, the 5th V however exists only if there is high inter-rater reliability (IRR) within the data elements. The purpose of this work was to assess IRR in the nationally deployed RO-ILS: Radiation Oncology-Incident Learning System (R) sponsored by the American Society for Radiation Oncology (ASTRO) and the American Association of Physicists in Medicine (AAPM). Methods: Ten incident reports covering a wide range of scenarios were created in standardized narrative and video formats and disseminated to 67 volunteers of multiple disciplines from 26 institutions along with two published narratives from the International Commission of Radiological Protection to assess IRR on a nationally representative level. The volunteers were instructed to independently enter the associated data elements in a test version of RO-ILS over a 3-week period. All responses were aggregated into a spreadsheet to assess IRR using free-marginal kappa metrics. Results: 48 volunteers from 21 institutions completed all reports in the study period. The average kappa score for all raters across all critical data elements was 0.659 [range 0.326–1.000]. Statistically significant differences (p <0.05) were noted between reporters of different disciplines and raters with varying levels of experience. Kappa scores were high for event classification (0.781) and contributory factors (0.777) and low for likelihood-of-harm (0.326). IRR was highest among AAPM-ASTRO members (0.672) and lowest among trainees (0.463). Conclusion: A moderate-to-substantial level of IRR in RO-ILS was noted in this study. Although the number of events reviewed in this study was small, opportunities for improving the taxonomy for the lower scoring data elements as well as specific educational targets for training were identified by assessing data veracity quantitatively. This is expected to improve the quality of the data garnered from RO-ILS.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Marine Renewable Energy Applications for Restorative Ocean Farming: Kelp

Kelp farming and kelp forest restoration have both been proposed as a solution to locally decrease the impacts of ocean acidification and eutrophication, often with co-benefits to other forms of aquaculture and mariculture. Compared to global markets, the kelp industry in the United States is still in its early phases, with the first commercial kelp farm founded in Casco Bay, Maine in 2010. Since then, interest and effort in kelp production has been increasing, with farms now present in Maine, New Hampshire, Connecticut, Rhode Island, Massachusetts, New York, Washington, and Alaska. Many research projects are underway in the United States to explore benefits of 3D ocean farming, tackle logistical problems of working in the ocean, autonomous farming, and explore viable end uses for kelp products. In seaweed farming, to remove the stored carbon or excess nutrients from the system, the biomass needs to be harvested at the optimal time to avoid the release of CO 2 that comes with decomposition. Timing of the harvest is also important for maximum crop yield, which can vary based on the final product. Additional monitoring needs can include a variety of water quality metrics, growth measurements, and visuals to ensure the health of the farm, comply with permits, support operations and maintenance functions. The variables measured may vary by desired end use of the product, location of farm, and operational design. Monitoring all of these parameters requires specialized devices that can be costly and challenging to maintain. Monitoring devices often face power and logistical constraints that could prevent kelp farmers from adopting these technologies or receiving accurate, efficient monitoring to assess ecosystem benefits and valuation. Marine energy has been identified as a possible power source for these devices. This project investigates the power needs for conducting kelp farm environmental monitoring compared with the available marine energy resource to evaluate if locally generated ocean energy could provide a solution to these monitoring challenges and benefit kelp farmers. This process was structured as follows: 1. Define what data is needed for farmers and their communities through desk research and interviews with end users. 2. Identify sensors and power requirements currently in use or available for commercial purchase. 3. Analyze current kelp and other mariculture farm locations for the potential marine energy resource. 4. Analyze farm designs and associated structures to make recommendations for marine energy design. 5. Quantify value that investment in sensors could provide in terms of carbon credit possibilities.

09 BIOMASS FUELS↗