SEARCH · Engineering Papers

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Marine Renewable Energy Applications for Restorative Ocean Farming: Kelp

Kelp farming and kelp forest restoration have both been proposed as a solution to locally decrease the impacts of ocean acidification and eutrophication, often with co-benefits to other forms of aquaculture and mariculture. Compared to global markets, the kelp industry in the United States is still in its early phases, with the first commercial kelp farm founded in Casco Bay, Maine in 2010. Since then, interest and effort in kelp production has been increasing, with farms now present in Maine, New Hampshire, Connecticut, Rhode Island, Massachusetts, New York, Washington, and Alaska. Many research projects are underway in the United States to explore benefits of 3D ocean farming, tackle logistical problems of working in the ocean, autonomous farming, and explore viable end uses for kelp products. In seaweed farming, to remove the stored carbon or excess nutrients from the system, the biomass needs to be harvested at the optimal time to avoid the release of CO 2 that comes with decomposition. Timing of the harvest is also important for maximum crop yield, which can vary based on the final product. Additional monitoring needs can include a variety of water quality metrics, growth measurements, and visuals to ensure the health of the farm, comply with permits, support operations and maintenance functions. The variables measured may vary by desired end use of the product, location of farm, and operational design. Monitoring all of these parameters requires specialized devices that can be costly and challenging to maintain. Monitoring devices often face power and logistical constraints that could prevent kelp farmers from adopting these technologies or receiving accurate, efficient monitoring to assess ecosystem benefits and valuation. Marine energy has been identified as a possible power source for these devices. This project investigates the power needs for conducting kelp farm environmental monitoring compared with the available marine energy resource to evaluate if locally generated ocean energy could provide a solution to these monitoring challenges and benefit kelp farmers. This process was structured as follows: 1. Define what data is needed for farmers and their communities through desk research and interviews with end users. 2. Identify sensors and power requirements currently in use or available for commercial purchase. 3. Analyze current kelp and other mariculture farm locations for the potential marine energy resource. 4. Analyze farm designs and associated structures to make recommendations for marine energy design. 5. Quantify value that investment in sensors could provide in terms of carbon credit possibilities.

09 BIOMASS FUELS↗

NASA NTRS2004

Defect measurement and analysis of JPL ground software: a case study

Ground software systems at JPL must meet high assurance standards while remaining on schedule due to relatively immovable launch dates for spacecraft that will be controlled by such systems. Toward this end, the Software Quality Improvement (SQI) project's Measurement and Benchmarking (M&B) team is collecting and analyzing defect data of JPL ground system software projects to build software defect prediction models. The aim of these models is to improve predictability with regard to software quality activities. Predictive models will quantitatively define typical trends for JPL ground systems as well as Critical Discriminators (CDs) to provide explanations for atypical deviations from the norm at JPL. CDs are software characteristics that can be estimated or foreseen early in a software project's planning. Thus, these CDs will assist in planning for the predicted degree to which software quality activities for a project are likely to deviation from the normal JPL ground system based on pasted experience across the lab.

defects↗

DOE OSTI2021

Assessing data change in scientific datasets

Summary Scientific datasets are growing rapidly and becoming critical to next‐generation scientific discoveries. The validity of scientific results relies on the quality of data used and data are often subject to change, for example, due to observation additions, quality assessments, or processing software updates. The effects of data change are not well understood and difficult to predict. Datasets are often repeatedly updated and recomputing derived data products quickly becomes time consuming and resource intensive and may in some cases not even be necessary, thus delaying scientific advance. Despite its importance, there is a lack of systematic approaches for best comparing data versions to quantify the changes, and ad‐hoc or manual processes are commonly used. In this article, we propose a novel hierarchical approach for analyzing data changes, including real‐time (online) and offline analyses. We employ a variety of fast‐to‐compute numerical analyses, graphical data change representations, and more resource‐intensive recomputations of a subset of the data product. We illustrate the application of our approach using three scientific diverse use cases, namely, satellite, cosmological, and x‐ray data. The results show that a variety of data change metrics should be employed to enable a comprehensive representation and qualitative evaluation of data changes.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2013

Spatial frequency spectrum of the x-ray scatter distribution in CBCT projections

Purpose: X-ray scatter is a source of significant image quality loss in cone-beam computed tomography (CBCT). The use of Monte Carlo (MC) simulations separating primary and scattered photons has allowed the structure and nature of the scatter distribution in CBCT to become better elucidated. This work seeks to quantify the structure and determine a suitable basis function for the scatter distribution by examining its spectral components using Fourier analysis.Methods: The scatter distribution projection data were simulated using a CBCT MC model based on the EGSnrc code. CBCT projection data, with separated primary and scatter signal, were generated for a 30.6 cm diameter water cylinder [single angle projection with varying axis-to-detector distance (ADD) and bowtie filters] and two anthropomorphic phantoms (head and pelvis, 360 projections sampled every 1°, with and without a compensator). The Fourier transform of the resulting scatter distributions was computed and analyzed both qualitatively and quantitatively. A novel metric called the scatter frequency width (SFW) is introduced to determine the scatter distribution's frequency content. The frequency content results are used to determine a set basis functions, consisting of low-frequency sine and cosine functions, to fit and denoise the scatter distribution generated from MC simulations using a reduced number of photons and projections. The signal recovery is implemented using Fourier filtering (low-pass Butterworth filter) and interpolation. Estimates of the scatter distribution are used to correct and reconstruct simulated projections.Results: The spatial and angular frequencies are contained within a maximum frequency of 0.1 cm{sup −1} and 7/(2π) rad{sup −1} for the imaging scenarios examined, with these values varying depending on the object and imaging setup (e.g., ADD and compensator). These data indicate spatial and angular sampling every 5 cm and π/7 rad (∼25°) can be used to properly capture the scatter distribution, with reduced sampling possible depending on the imaging scenario. Using a low-pass Butterworth filter, tuned with the SFW values, to denoise the scatter projection data generated from MC simulations using 10{sup 6} photons resulted in an error reduction of greater than 85% for the estimating scatter in single and multiple projections. Analysis showed that the use of a compensator helped reduce the error in estimating the scatter distribution from limited photon simulations by more than 37% when compared to the case without a compensator for the head and pelvis phantoms. Reconstructions of simulated head phantom projections corrected by the filtered and interpolated scatter estimates showed improvements in overall image quality.Conclusions: The spatial frequency content of the scatter distribution in CBCT is found to be contained within the low frequency domain. The frequency content is modulated both by object and imaging parameters (ADD and compensator). The low-frequency nature of the scatter distribution allows for a limited set of sine and cosine basis functions to be used to accurately represent the scatter signal in the presence of noise and reduced data sampling decreasing MC based scatter estimation time. Compensator induced modulation of the scatter distribution reduces the frequency content and improves the fitting results.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

NASA NTRS2017

Mind the Gap: Exploring the Underground of the NASA Space Cancer Risk Model

The REID quantifies the lifetime risk of death from radiation-induced cancer in an exposed astronaut. The NASA Space Cancer Risk (NSCR) 2012 mode incorporates elements from physics, biology, epidemiology, and statistics to generate the REID distribution. The current model quantifies the space radiation environment, radiation quality, and dose-rate effects to estimate a NASA-weighted dose. This weighted dose is mapped to the excess risk of radiation-induced cancer mortality from acute exposures to gamma rays and then transferred to an astronaut population. Finally, the REID is determined by integrating this risk over the individual's lifetime. The calculated upper 95% confidence limit of the REID is used to restrict an astronaut's permissible mission duration (PMD) for a proposed mission. As a statistical quantity characterized by broad, subjective uncertainties, REID estimates for space missions result in wide distributions. Currently, the upper 95% confidence level is over 350% larger than the mean REID value, which can severely limit an astronaut's PMD. The model incorporates inputs from multiple scientific disciplines in the risk estimation process. Physics and particle transport models calculate how radiation moves through space, penetrates spacecraft, and makes its way to the human beings onboard. Epidemiological studies of exposures from atomic bombings, medical treatments, and power plants are used to quantify health risks from acute and chronic low linear energy transfer (LET) ionizing radiation. Biological studies in cellular and animal models using radiation at various LETs and energies inform quality metrics for ions present in space radiation. Statistical methodologies unite these elements, controlling for mathematical and scientific uncertainty and variability. Despite current progress, these research platforms contain knowledge gaps contributing to the large uncertainties still present in the model. The NASA Space Radiation Program Element (SRPE) defines the knowledge gaps that impact our understanding of the cancer risks. These gaps are outlined in NASA's Human Research Roadmap [4], which identifies the research questions and actions recommended for reducing the uncertainty in the current NSCR model and for formulation of future models. The greatest contributors to uncertainty in the current model include radiation quality, dose rate effects, and the transfer of exposure-based risk from other populations to an astronaut population. Future formulations of the risk model may benefit from including other potential sources of uncertainty such as space dosimetry, errors in human epidemiology data, and the impact of microgravity and other spaceflight stressors. Here, we discuss the current capabilities of the NSCR-2012 model and several immediate research needs, highlighting areas expected to have an operational impact on the current model schema. The following subway-style route map outlines the NSCR-2012 model (Green Line), emphasizing the research gaps in the Human Research Roadmap for risk of radiation-induced carcinogenesis (Stops on Dashed Lines). The map diagrams how these research gaps feed specific portions of the model.

Chappell, L. J.↗

NASA NTRSDate not supplied

Visualizing Geospatial Data through ESRI Story Maps for Earth Science Education: Lessons Learned from My NASA Data

For 20 years My NASA Data (MND) has curated NASA Earth science data and provided the data to educators in engaging learner-centered resources. MND has recently featured story maps as an innovative way to engage students in NASA Earth data. A story map is a cloud-based lesson that engages the learner in interactive geospatial maps using NASA data, and other multimedia content, text, and tasks that can be seamlessly incorporated in classroom instruction. This immersive technology eliminates the need for the user to move among tricky interfaces to access and visualize Earth science data, and no special software is required to be downloaded. Each story map integrates data from different NASA satellite missions, retrieved from Distributed Active Archive Centers (DAACs). Story maps also employ data analysis tools, such as time series options and swipe tools that allow learners to view and analyze relationships between scientific variables. MND has produced 25 story map lesson plans on the topics of air quality, the urban heat island effect, Earth’s energy budget, phytoplankton distribution, hurricane formation, solar eclipses, ocean circulation patterns, sea ice extent, and volcanic eruptions. Nine of them are extended story maps and written in the 5E format, which is internationally recognized as best practice based on how children learn science. Each story map resource is developed by the MND team featuring a GIS programming specialist, a lead scientist, and educational specialist/s to ensure the context, content, and methods are scientifically and educationally sound. The MND story maps are written for middle and high school science teachers and students as they connect with the Earth Systems Science phenomena featured in the Next Generation Science Standards. Each story map includes supporting resources for smooth integration in the classroom. During Fiscal Year 2023, The My NASA Data website received over 100,000 story map engagements during. These metrics highlight the interest in story maps as an Earth Science educational resource.

Desiray Wilson↗

DOE OSTI2018

Managing Through Continuous Improvement: If it doesn’t challenge you, it won’t change you

The past 24 months has been one of non-stop continuous improvement – every month, every week, every day, and every hour. It has been filled with continuously re-examining and challenging business systems, work processes, and legacy culture. The journey was difficult, but well worth it. It began by examining the existing conditions in each organization and building the case for change. When we stepped back and looked at our processes, systems, tools, and performance objectively, we realized we were struggling with frequent organizational, resource, and schedule conflicts, work processes that were not well-defined or expert based, project delays were common, management methods were predominantly reactive, advanced planning was limited to the near-term, no integration in scheduling across organizations, limited to no performance metrics to measure and manage performance, and internal and external customers did not feel like we were meeting their quality and performance expectations. It was a wake-up call. Change began at the top with a change leadership with where a new vision, expectations, and commitment were established. Leaving no stone left unturned, every aspect of the business was challenged which opened up communication and exposed the gaps. This was done in a ‘safe’ environment allowing for honest and solution-oriented discussion and action. The leadership team committed to managing through continuous improvement. The organizational structure was realigned to better align scope, responsibilities, execution, and customer focus. Visibility and transparency became the norm as higher levels of leadership and supporting organizations were invited to be part of regular strategy meetings and partnership discussion, effectively opening up the dialogue. This required a tremendous amount of trust and faith in a short period of time. Health assessments were conducted on each organization with specific lines of inquiry. These self-assessments helped to identify better define the scope of the organization and where targeted improvements were needed. Frequent organizational reviews were implemented to answer three fundamental questions: 1) What is your organization paid to do (scope)?, 2) How does your organization, or you, demonstrate that you are doing the job effectively?, and 3) What are you doing to improve your performance? To answer the first question, leaders defined the scope of the organization. Leaders were required to provide a path forward, with specific actions, where performance was not at expected levels internally at first and then from the stakeholders. Where business processes were not clearly understood, process maps were developed to provide this clarity for both those performing the work and those utilizing the process – the customers. To help answer the second question, numerous automated or semi-automated real-time, dynamic performance metrics were developed and implement to help leaders gain the visibility and demonstrate performance in six areas of operational excellence: safety, security, quality, effectiveness, productivity, and sustainability. Analysis of the performance provided windows of transparency and trends of work performance, work delays, cycle times, utilization, and much more that revealed many areas of improvement that were either not visible or desired to be visible. At the same time, they provided real-time progress which generated initial performance improvements by just beginning to measure. To address the third question, where systems did not support effectiveness of an existing or new process, then systems and tools were developed and implemented to drive the right behaviors and reinforce the processes. Tools and metrics were one of the major catalysts for culture shift and change. Risk assessments were leveraged into continuous improvement strategies, plans, and schedules. Targeted initiatives were identified and performed. Change and improvement was not, and is not, without significant and common challenges including limited/fixed budgets, resource availability, data access, natural resistance to change, and numerous other reasons or excuses – we called them ‘off-ramps’ and began to close them one-by-one. The results and outputs were significant and impactful in each organization and across the business with increased productivity, efficiency, visibility, accountability, management, and performance. Stakeholder satisfaction also increased. Cost and time savings allowed to more continuous improvement efforts to be performed. The effort clearly provided clear and measurable return on investment and value. Efforts that once seemed impossible, not feasible, or not achievable were performed. Decades-long issues were solved. ‘Impossible things are simply those which so far have never been done’ said Elbert Hubbard. So what will the next year be for you and your organization? Are you satisfied with the ‘same ‘ol, same ‘ol?’ Will you fall into the complacency trap and believe that change is too difficult, too expensive, and not necessary (or any number of possible excuses) or will you make this year your year or continuous improvement (and every year thereafter…)? Remember – what you do today can improve all your tomorrows’ (Ralph Marston).

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

NASA NTRS1986

Software unit testing in Ada environment

A validation procedure for the Ada binding of the Graphical Kernel System (GKS) is being developed. PRIOR Data Sciences is also producing a version of the GKS written in Ada. These major software engineering projects will provide an opportunity to demonstrate a sound approach for software testing in an Ada environment. The GKS/Ada validation capability will be a collection of test programs and data, and test management guidelines. These products will be used to assess the correctness, completeness, and efficiency of any GKS/Ada implementation. The GKS/Ada developers will be able to obtain the validation software for their own use. It is anticipated that this validation software will eventually be taken over by an independent standards body to provide objective assessments of GKS/Ada implementations, using an approach similar to the validation testing currently applied to Ada compilers. In the meantime, if requested, this validation software will be used to assess GKS/Ada products. The second project, implementation of GKS using the Ada language, is a conventional software engineering tasks. It represents a large body of Ada code and has some interesting testing problems associated with automatic testing of graphics routines. Here the normal test practices which include automated regression testing, independent quality assistance, test configuration management, and the application of software quality metrics will be employed. The software testing methods emphasize quality enhancement and automated procedures. Ada makes some aspects of testing easier, and introduces some concerns. These issues are addressed.

Warnock, Glenn↗

NASA NTRS2011

Tracking Climate Effects on Plant-Pollinator Interaction Phenology with Satellites and Honey Bee Hives

Background/Question/Methods: The complexity of plant-pollinator interactions, the large number of species involved, and the lack of species response functions present challenges to understanding how these critical interactions may be impacted by climate and land cover change on large scales. Given the importance of this interaction for terrestrial ecosystems, it is desirable to develop new approaches. We monitor the daily weight change of honey bee (Apis mellifera) colonies to record the phenology of the Honey Bee Nectar Flow (HBNF) in a volunteer network (honeybeenet.gsfc.nasa.gov). The records document the successful interaction of a generalist pollinator with a variety of plant resources. We extract useful HBNF phenology metrics for three seasons. Sites currently exist in 35 states/provinces in North America, with a concentration in the Mid-Atlantic region. HBNF metrics are compared to standard phenology metrics derived from remotely sensed vegetation indices from NASA's MODIS sensor and published results from NOAA's A VHRR. At any given time the percentage of plants producing nectar is usually a sma11 fraction of the total satellite sensor signal. We are interested in determining how well the 'bulk' satellite vegetation parameters relate to the phenology of the HBNF, and how it varies spatially on landscape to continental scales. Results/Conclusions: We found the median and peak seasonal HBNF dates to be robust, with variation between replicate scale hives of only a few days. We developed quality assessment protocols to identify abnormal colony artifacts. Temporally, the peak and median of the HBNF in the Mid-Atlantic show a significant advance of 0.58 d/y beginning about 1970, very similar to that observed by the A VHRR since 1982 (0.57 d/y). Spatially, the HBNF metrics are highly correlated with elevation and winter minimum temperature distribution, and exhibit significant but regionally coherent inter-annual variation. The relationship between median of the spring HBNF with the "Green-up" metric from the 500 meter MODIS NDVI phenology product, for sites throughout the Eastern US 2000-2009, is well described by a single linear fit (r(exp 2) = 0.72). We conclude.that for the tree-dominated areas of the Eastern US at least the spring HBNF can be tracked very well by MODIS phenology. Analysis of other regions and seasons is presently underway but with more limited data. Spatial patterns in the eastern US and management implications will be presented and discussed.

Esaias, Wayne E.↗

DOE OSTI2018

Do citations and readership identify seminal publications?

Here, this work presents a new approach for analysing the ability of existing research metrics to identify research which has strongly influenced future developments. More specifically, we focus on the ability of citation counts and Mendeley reader counts to distinguish between publications regarded as seminal and publications regarded as literature reviews by field experts. The main motivation behind our research is to gain a better understanding of whether and how well the existing research metrics relate to research quality. For this experiment we have created a new dataset which we call TrueImpactDataset and which contains two types of publications, seminal papers and literature reviews. Using the dataset, we conduct a set of experiments to study how citation and reader counts perform in distinguishing these publication types, following the intuition that causing a change in a field signifies research quality. Finally, our research shows that citation counts work better than a random baseline (by a margin of 10%) in distinguishing important seminal research papers from literature reviews while Mendeley reader counts do not work better than the baseline.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2016

SU-F-J-175: Evaluation of Metal Artifact Reduction Algorithms in Computed Tomography and Their Application to Radiation Therapy Treatment Planning

Purpose: High-Z (metal) implants in CT scans cause significant streak-like artifacts in the reconstructed dataset. This results in both inaccurate CT Hounsfield units for the tissue as well as obscuration of the target and organs at risk (OARs) for radiation therapy planning. Herein we analyze two metal artifact reduction algorithms: GE’s Smart MAR and a Metal Deletion Technique (MDT) for geometric and Hounsfield Unit (HU) accuracy. Methods: A CT-to-electron density phantom, with multiple inserts of various densities and a custom Cerrobend insert (Zeff=76.8), is utilized in this continuing study. The phantom is scanned without metal (baseline) and again with the metal insert. Using one set of projection data, reconstructed CT volumes are created with filtered-back-projection (FBP) and the MAR and the MDT algorithms. Regions-of-Interest (ROIs) are evaluated for each insert for HU accuracy; the metal insert’s Full-Width-Half-Maximum (FWHM) is used to evaluate the geometric accuracy. Streak severity is quantified with an HU error metric over the phantom volume. Results: The original FBP reconstruction has a Root-Mean-Square-Error (RMSE) of 57.55 HU (STD=29.19, range=−145.8 to +79.2) compared to baseline. The MAR reconstruction has a RMSE of 20.98 HU (STD=13.92, range=−18.3 to +61.7). The MDT reconstruction has a RMSE of 10.05 HU (STD=10.5, range=−14.8 to +18.6). FWHM for baseline=162.05; FBP=161.84 (−0.13%); MAR=162.36 (+0.19%); MDT=162.99 (+0.58%). Streak severity metric for FBP=19.73 (22.659% bad pixels); MAR=8.743 (9.538% bad); MDT=4.899 (5.303% bad). Conclusion: Image quality, in terms of HU accuracy, in the presence of high-Z metal objects in CT scans is improved by metal artifact reduction reconstruction algorithms. The MDT algorithm had the highest HU value accuracy (RMSE=10.05 HU) and best streak severity metric, but scored the worst in terms of geometric accuracy. Qualitatively, the MAR and MDT algorithms increased detectability of inserts, although there is a loss of in-plane resolution near the metallic insert.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Quantifying Solar PV Variability at Multiple Timescales for Power Systems Studies: Preprint

Increasing penetration of solar photovoltaics (PV) has concerned power system operators about their ability to balance load and generation over multiple timescales and maintain acceptable frequency profile because of the variability and uncertainty associated with solar PV. This paper focuses on developing metrics to quantify solar PV variability at multiple temporal scales ranging from seconds to an hour to help power system operators and planners better understand and account for solar PV variability under high solar PV penetration. Fourier coefficients of solar irradiation spectrum and average size of solar irradiation ramps over a day are the two metrics that are used to quantity the variability. It is shown that by using the two metrics the days with highest and lowest solar irradiation variability can be identified, which is useful information for operations planning or long-term power system planning studies. The key findings of the paper are (i) single sensor-based variability quantification can significantly exaggerate the variability of a solar PV plant, particularly at seconds to 1-min temporal resolution, (ii) at 1-minute or lower temporal resolutions, single sensor-based variability quantification of an entire plant can be fairly accurate, with the accuracy increasing as the temporal resolution reduces from 1-minute to 1-hour, (iii) at each 1-minute and lower temporal resolutions, maximum solar irradiation ramps appear to be independent of the geographical location of the sensor, and (iv) significant reduction in solar PV plant variability over a region with multiple plants is possible at all temporal scales, but more high quality, high temporal resolution data is needed to quantify the reduction with high confidence.

photovoltaics↗

DOE OSTI2012

A Comparison of Image Quality Evaluation Techniques for Transmission X-Ray Microscopy

Beamline 6-2c at Stanford Synchrotron Radiation Lightsource (SSRL) is capable of Transmission X-ray Microscopy (TXM) at 30 nm resolution. Raw images from the microscope must undergo extensive image processing before publication. Since typical data sets normally contain thousands of images, it is necessary to automate the image processing workflow as much as possible, particularly for the aligning and averaging of similar images. Currently we align images using the 'phase correlation' algorithm, which calculates the relative offset of two images by multiplying them in the frequency domain. For images containing high frequency noise, this algorithm will align noise with noise, resulting in a blurry average. To remedy this we multiply the images by a Gaussian function in the frequency domain, so that the algorithm ignores the high frequency noise while properly aligning the features of interest (FOI). The shape of the Gaussian is manually tuned by the user until the resulting average image is sharpest. To automatically optimize this process, it is necessary for the computer to evaluate the quality of the average image by quantifying its sharpness. In our research we explored two image sharpness metrics, the variance method and the frequency threshold method. The variance method uses the variance of the image as an indicator of sharpness while the frequency threshold method sums up the power in a specific frequency band. These metrics were tested on a variety of test images, containing both real and artificial noise. To apply these sharpness metrics, we designed and built a MATLAB graphical user interface (GUI) called 'Blur Master.' We found that it is possible for blurry images to have a large variance if they contain high amounts of noise. On the other hand, we found the frequency method to be quite reliable, although it is necessary to manually choose suitable limits for the frequency band. Further research must be performed to design an algorithm which automatically selects these parameters.

99 GENERAL AND MISCELLANEOUS↗

NASA NTRS2011

Report on the Global Data Assembly Center (GDAC) to the 12th GHRSST Science Team Meeting

In 2010/2011 the Global Data Assembly Center (GDAC) at NASA's Physical Oceanography Distributed Active Archive Center (PO.DAAC) continued its role as the primary clearinghouse and access node for operational Group for High Resolution Sea Surface Temperature (GHRSST) datastreams, as well as its collaborative role with the NOAA Long Term Stewardship and Reanalysis Facility (LTSRF) for archiving. Here we report on our data management activities and infrastructure improvements since the last science team meeting in June 2010.These include the implementation of all GHRSST datastreams in the new PO.DAAC Data Management and Archive System (DMAS) for more reliable and timely data access. GHRSST dataset metadata are now stored in a new database that has made the maintenance and quality improvement of metadata fields more straightforward. A content management system for a revised suite of PO.DAAC web pages allows dynamic access to a subset of these metadata fields for enhanced dataset description as well as discovery through a faceted search mechanism from the perspective of the user. From the discovery and metadata standpoint the GDAC has also implemented the NASA version of the OpenSearch protocol for searching for GHRSST granules and developed a web service to generate ISO 19115-2 compliant metadata records. Furthermore, the GDAC has continued to implement a new suite of tools and services for GHRSST datastreams including a Level 2 subsetter known as Dataminer, a revised POET Level 3/4 subsetter and visualization tool, a Google Earth interface to selected daily global Level 2 and Level 4 data, and experimented with a THREDDS catalog of GHRSST data collections. Finally we will summarize the expanding user and data statistics, and other metrics that we have collected over the last year demonstrating the broad user community and applications that the GHRSST project continues to serve via the GDAC distribution mechanisms. This report also serves by extension to summarize the activities of the GHRSST Data Assembly and Systems Technical Advisory Group (DAS-TAG).

sea surface temperature (SST)↗

DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

NASA NTRS2021

Quantifying the Impacts of PM2.5 Constituents and Relative Humidity on Visibility Impairment in a Suburban Area of Eastern Asia Using Long-Term In-Situ Measurements.

The deterioration of visibility due to air pollutants and relative humidity has been a serious environmental problem in eastern Asia. In most previous studies, chemical compositions of atmospheric particles were provided using filter-based offline analyses, which were unable to provide long-term and in-situ measurements that resolve sufficient temporal variations of air pollution and meteorology, hindering the resolution of the relationship between air quality and visibility. Here, we present a year-long continuously measured data from a comprehensive suite of online instruments to investigate diurnal and seasonal impacts of the aerosol chemical compositions in PM2.5 on visibility seasonally and diurnally. The measured dry aerosol extinction at λ = 550 nm reached a closure with that predicted by aerosol compositions within 12%. However, the hygroscopic growth of particles under ambient RH could enhance the aerosol extinction by a factor of 2 – 6, matching the perceptive visibility of the public. Particulate ammonium nitrate was most sensitive to reducing visibility, while ammonium sulfate contributed the most to the light extinction. In spring and winter, the monsoon and stagnant air masses reduced the visibility and increased PM2.5 (> 35 μg m-3).The moisture was found to substantially enhance the light extinction under RH = 60 – 90%,reducing visibility by approximately 15 km, largely attributed to hygroscopic inorganic salts.This study serves as a metric to highlight the need to consider the influence of RH, and aqueous reactions in producing secondary inorganic aerosols on atmospheric visibility, underpinning the more accurate mitigation strategies of air pollution.

visibility↗

DOE OSTI2023

Enhanced Surgical Decision-Making Tools in Breast Cancer: Predicting 2-Year Postoperative Physical, Sexual, and Psychosocial Well-Being following Mastectomy and Breast Reconstruction (INSPiRED 004)

Background: We sought to predict clinically meaningful changes in physical, sexual, and psychosocial well-being for women undergoing cancer-related mastectomy and breast reconstruction 2 years after surgery using machine learning (ML) algorithms trained on clinical and patient-reported outcomes data. Patients and Methods: We used data from women undergoing mastectomy and reconstruction at 11 study sites in North America to develop three distinct ML models. We used data of ten sites to predict clinically meaningful improvement or worsening by comparing pre-surgical scores with 2 year follow-up data measured by validated Breast-Q domains. We employed ten-fold cross-validation to train and test the algorithms, and then externally validated them using the 11th site’s data. We considered area-under-the-receiver-operating-characteristics-curve (AUC) as the primary metric to evaluate performance. Results: Overall, between 1454 and 1538 patients completed 2 year follow-up with data for physical, sexual, and psychosocial well-being. In the hold-out validation set, our ML algorithms were able to predict clinically significant changes in physical well-being (chest and upper body) (worsened: AUC range 0.69–0.70; improved: AUC range 0.81–0.82), sexual well-being (worsened: AUC range 0.76–0.77; improved: AUC range 0.74–0.76), and psychosocial well-being (worsened: AUC range 0.64–0.66; improved: AUC range 0.66–0.66). Baseline patient-reported outcome (PRO) variables showed the largest influence on model predictions. Conclusions: Machine learning can predict long-term individual PROs of patients undergoing postmastectomy breast reconstruction with acceptable accuracy. This may better help patients and clinicians make informed decisions regarding expected long-term effect of treatment, facilitate patient-centered care, and ultimately improve postoperative health-related quality of life.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2019

The ILRS: Approaching 20 Years and Planning for the Future

The International Laser Ranging Service (ILRS) was established by the International Association of Geodesy (IAG) in 1998 to support programs in geodesy, geophysics, fundamental constants and lunar research, and to provide the International Earth Rotation Service with data products that are essential to the maintenance and improvement in the International Terrestrial Reference Frame (ITRF), the basis for metric measurements of changes in the Earth and Earth–Moon system. Other scientific products derived from laser ranging include precise geocentric positions and motions of ground stations, satellite orbits, components of Earth’s gravity field and their temporal variations, Earth Orientation Parameters, precise lunar ephemerides and information about the internal structure of the Moon. Laser ranging systems are already measuring the one-way distance to remote optical receivers in space and are performing very accurate time transfer between remote sites in the Earth and in Space. The ILRS works closely with the IAG’s Global Geodetic Observing System. The ILRS develops (1) the standards and specifications necessary for product consistency, and (2) the priorities and tracking strategies required to maximize network efficiency. The service collects, merges, analyzes, archives and distributes satellite and lunar laser ranging data to satisfy a variety of scientific, engineering, and operational needs and encourages the application of new technologies to enhance the quality, quantity, and cost effectiveness of its data products. The ILRS works with (1) new satellite missions in the design and building of retroreflector targets to maximize data quality and quantity, and (2) science programs to optimize scientific data yield. Since its inception, the ILRS has grown to include forty laser ranging stations distributed around the world. The ILRS stations track more than ninety satellites from low Earth orbit (LEO) to the geosynchronous orbit altitude as well as retroreflector arrays on the surface of the Moon. Applications have been expanded to include time transfer, asynchronous ranging for targets at extended ranges, free space quantum telecommunications, and the tracking of space debris. Laser ranging technology is moving to lower energy, higher repetition rates (kHz), single-photon-sensitive detectors, shorter pulse widths, shorter normal point intervals for faster data acquisition, and increased pass interleaving, automated to autonomous operation with remote access, and embedded software for real-time updates and decision making. An example of pass interleaving is presented for the Yarragadee station (see Fig. 4); tracking of LEO satellites is often accommodated during break in LEO and GNSS passes. New satellites arrays provide more compact targets and work continues on the development of lighter less expensive arrays for satellites and the moon. The service now provides operational ITRF products including daily/ weekly station positions and daily resolution Earth orientation products; the flow of weekly combination of satellite orbit files for LAGEOS/Etalon-1 and -2 has recently been established. New products are under testing through a pilot project on systematic error monitoring currently underway. The article will give an overview of activities underway within the service, paths forward presently envisioned, and current issues and challenges.

Laser retroreflectors↗