Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “curation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Ultraviolet Fluorescence Imaging for Photovoltaic Module Metrology: Best Practices and Survey of Features Observed in Fielded Modules

As the photovoltaics (PV) industry grows in sophistication, so must the extent to which systems are characterized. UV Fluorescence (UVF) imaging is a valuable, easy-to-perform, high-throughput, nonintrusive technique for characterizing modules in the field and in the lab. However, UVF is still a relatively new technique, and many in the PV industry are still unaware of its potential. We provide a guideline for obtaining, processing, and interpreting UVF images. We have provided a list of considerations for imaging hardware and settings, a suggested pipeline for image processing, and details on a survey of features shown in UVF images. As a result, a new database with UVF images of 7190 modules and another database curated by BrightSpot Automation are publicly available.

14 SOLAR ENERGY↗

A Cast of Thousands: How the IDEAS Productivity Project Has Advanced Software Productivity and Sustainability

Computational and data-enabled science and engineering are revolutionizing advances throughout science and society, at all scales of computing. For example, teams in the U.S. Department of Energy’s Exascale Computing Project have been tackling new frontiers in modeling, simulation, and analysis by exploiting unprecedented exascale computing capabilities—building an advanced software ecosystem that supports next-generation applications and addresses disruptive changes in computer architectures. However, concerns are growing about the productivity of the developers of scientific software. Members of the Interoperable Design of Extreme-scale Application Software project serve as catalysts to address these challenges through fostering software communities, incubating and curating methodologies and resources, and disseminating knowledge to advance developer productivity and software sustainability. This article discusses how these synergistic activities are advancing scientific discovery—mitigating technical risks by building a firmer foundation for reproducible, sustainable science at all scales of computing, from laptops to clusters to exascale and beyond.

97 MATHEMATICS AND COMPUTING↗

A Multi-Tier Provenance Model for Global Climate Research

Global climate researchers rely upon many forms of sensor data and analytical methods to help profile subtle changes in climate conditions. The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) program provides researchers with curated products called Value Added Products (VAPs) resulting from continuous instrumentation streams, data fusion, and analytical profiling. To provide these projects the ARM operations and research teams rely upon a number of techniques to ensure strict quality control and quality assurance codes are maintained. End users in the climate research community are highly interested in obtaining as much causal evidence as possible and currently either not all the evidence are easily attainable or easily identifiable without significant effort. Our research interests are to identify a provenance model that serves both the producers and consumers of the VAP maintaining the quality assurance/quality control standards and tailored to meeting the individual researcher’s needs.

54 ENVIRONMENTAL SCIENCES↗

A Bloom Filter Based Scalable Data Integrity Check Tool for Large-Scale Dataset

Large scale HPC applications are becoming increasingly data intensive. At Oak Ridge Leadership Computing Facility (OLCF), we are observing the number of files curated under individual project are reaching as high as 200 millions and project data size is exceeding petabytes. These simulation datasets, once validated, often needs to be transferred to archival system for long term storage or shared with the rest of the research community. Ensuring the data integrity of the full dataset at this scale is paramount important but also a daunting task. This is especially true considering that most conventional tools are serial and file-based, unwieldy to use and/or can't scale to meet user's demand.To tackle this particular challenge, this paper presents the design, implementation and evaluation of a scalable parallel checksumming tool, fsum, which we developed at OLCF. It is built upon the principle of parallel tree walk and work-stealing pattern to maximize parallelism and is capable of generating a single, consistent signature for the entire dataset at extreme scale. We also applied a novel bloom-filter based technique in aggregating signatures to overcome the signature ordering requirement. Given the probabilistic nature of bloom filter, we provided a detailed error and trade-off analysis. Using multiple datasets from production environment, we demonstrated that our tool can efficiently handle both very large files as well as many small-file based datasets. Our preliminary test showed that on the same hardware, it outperforms conventional tool by as much as 4×. It also exhibited near-linear scaling properties when provisioned with more compute resources.

97 MATHEMATICS AND COMPUTING↗

Suggested Modifications for Bifacial Capacity Testing

Capacity tests such as those described in ASTM 2848 and IEC 61724-2 are widely used during the contracting and acceptance testing of photovoltaic systems. With the increasing deployment of bifacial photovoltaic modules, there is a need to develop a standardized approach to capacity test these systems. Although variability and bias error were inherently higher for the measured capacity of bifacial systems, they could be reduced to a level consistent with the monofacial reference system by appropriate incorporation of rear irradiance—either measured or modeled. Three field installations provided bifacial system capacity that was measured with a mean bias error and standard deviation within 1% over the 2–10-month observation period. Capacity test accuracy could be improved further by using the measured back-of-module temperature and the IEC 61724-2 test method for well curated systems.

41 EE - Solar Energy Technologies Office (EE-4S)↗

A Reproducible Validation of Algorithms for Estimating Array Tilt and Azimuth from Photovoltaic Power Time Series

In this research, we assess the viability of four different, publicly available algorithms for estimating the azimuth and tilt parameters of solar photovoltaic systems using only the associated AC power time series data and site latitude-longitude coordinates. In this work, we curated a benchmarking data set of 44 fixed-tilt systems, comprising 275 measured AC power inverter data streams, with known azimuth and tilt parameters. Additionally, we isolated test cases in the data set with real- world issues, including shading and clipping, to determine how algorithm performance varies based on the presence of these phenomena. Using this data set for benchmarking, we evaluated the estimated vs. actual system characteristics for each algorithm, as well as the associated algorithm execution time using a standardized benchmarking process. The two highest performing algorithms were the Solar Data Tools and the PVWatts 5- based methods, which both achieved a median absolute error of approximately 5 and 1 degrees for azimuth and tilt, respectively. During run time analysis, the SDT method was approximately 5 times faster than the PVWatts 5-based method, with the median execution time for a stream varying between 6 and 8 seconds vs. a median run time of 31 seconds for the PVWatts 5-based method.

azimuth↗

EmSense: A High-Resolution Emulated Sensor for Experiments with the Smart Grid and Distributed Ledger Technology

This work involves the development of a device - EmSense (“Emulated Sensor”) - that emulates a high-resolution sensor for a power grid. The device collects raw current and voltage sensor data which derive from ORNL's signature library. This library is a dataset that ORNL curates from many different sources that include power systems from various utilities. The EmSense packages the data from the library in the form of IEC 61850 Sampled Value (SV) packets and then broadcasts these SV packets on the network. In another mode, EmSense can generate artificial sinusoidal data that appears as waveforms for voltage and current signals. EmSense has an internal algorithm for determining the period of a signal based on the data so that the period can be specified as a variable in the IEC 61850 packets. The purpose of EmSense is to allow for experimentation with the Dark Net Infrastructure where a variety of power line sensors must be represented along with their typical communication traffic. The EmSense device was developed in coordination with the software for receiving and processing the packets in the Distributed Ledger Technology (DLT) framework of the DarkNet Project. This receiving software must have a methodology for dealing with information of high velocity, variety, and volume. Experimenting with EmSense facilitates the development of such software. The results showed that the DLT framework and the trust-anchoring approach managed to process a large flow of traffic even with up to six instances of EmSense device broadcasting data. This was achieved without overfilling packet queues in the memory of the actual hardware of the DLT devices or causing the Central Processing Unit (CPU) of the hardware to be overwhelmed. The DLTs were also able to store the data in a compact and useful form for later analysis and archival purposes.

Werth, Aaron↗

Exaflops Biomedical Knowledge Graph Analytics

We are motivated by newly proposed methods for mining large-scale corpora of scholarly publications (e.g., full biomedical literature), which consists of tens of millions of papers spanning decades of research. In this setting, analysts seek to discover relationships among concepts. They construct graph representations from annotated text databases and then formulate the relationship-mining problem as an all-pairs shortest paths (APSP) and validate connective paths against curated biomedical knowledge graphs (e.g., Spoke). In this context, we present Coast (Exascale Communication-Optimized All-Pairs Shortest Path) and demonstrate 1.004 EF/s on 9,200 Frontier nodes (73,600 GCDs). We develop hyperbolic performance models (HYPERMOD), which guide optimizations and parametric tuning. The proposed Coast algorithm achieved the memory constant parallel efficiency of 99% in the single-precision tropical semiring. Looking forward, Coast will enable the integration of scholarly corpora like PubMed into the Spoke biomedical knowledge graph.

Kannan, Ramakrishnan {ramki}↗

Assessing Performance and Tradeoffs of Bioforensic Signature Systems

Chemical and biological forensic programs rely heavily on laboratory measurements to determine how a threat agent may have been produced. In addition to laboratory analyses, it may also be useful to identify institutions where the same threat agent has been produced by the same or a very similar process, since the producer of the agent may have learned methods at a university or similar institution. We developed a Bayesian network framework that combines the results of laboratory measurements with evidence from scientific literature to probabilistically rank institutions that have published papers on the agent of interest. As an example, we consider a network of three laboratory assays that are used to estimate the probabilities that a forensic sample of Yersinia pestis was produced using one of three culture media. We then apply techniques from multi-attribute decision science to assess and compare the performance of the various implementations of the Bayesian network in terms of three attributes: fidelity, document curation intensity, and consumption of the forensic sample. The mathematical approach we use to compare the various implementations is generalizable to the evaluation of other signature systems.

Watkins, Daniel M.↗

Differentially Private Distributed Sensing

The growth of the Internet of Things (IoT) creates the possibility of decentralized systems of sensing and actuation, potentially on a global scale. IoT devices connected to cloud networks can offer Sensing and Actuation as a Service (SAaaS) enabling networks of sensors to grow to a global scale. But extremely large sensor networks can violate privacy, especially in the case where IoT devices are mobile and connected directly to the behaviors of people. The thesis of this paper is that by adapting differential privacy (adding statistically appropriate noise to query results) to groups of geographically distributed sensors privacy could be maintained without ever sending all values up to a central curator and without compromising the overall accuracy of the data collected. This paper outlines such a scheme and performs an analysis of differential privacy techniques adapted to edge computing in a simulated sensor network where ground truth is known. The positive and negative outcomes of employing differential privacy in distributed networks of devices are discussed and a brief research agenda is presented.

Differential Privacy↗

The distribution, diversity and function of predominant Thermoproteales in high‐temperature environments of Yellowstone National Park

Summary High‐temperature environments (> 70°C) contain diverse and abundant members of the crenarchaeal order Thermoproteales. However, a comprehensive study of the distribution and function of diverse members of this group across different habitat types has not been conducted. Consequently, the goals of this study were to determine the distribution of different Thermoproteales genera across geochemically distinct geothermal habitats of Yellowstone National Park, and to identify key functional attributes of major genera that correlate with environmental parameters. Curated sequence assemblies belonging to five genera were characterized in replicate samples of 11 high‐temperature communities ranging in pH from 3 to 9. Thermocladium , Vulcanisaeta and Caldivirga spp. were the primary Thermoproteales populations present in low pH (pH < 5) habitats, whereas Thermoproteus populations were found in mildly‐acidic (pH 5–6) sulfur sediments, and Pyrobaculum populations were confined to higher pH (pH > 6) sulfur sediments and/or filamentous ‘streamer’ communities. Metabolic reconstruction and comparative genomics among assemblies show that these populations are primarily chemoorganotrophs that utilize different electron acceptors depending on geochemical conditions. The presence of potential CO 2 fixation pathways in some Thermoproteales populations appears to be linked with NiFe hydrogenases, which combined with high levels of H 2 in many sulfidic systems, may provide the energy required to fix inorganic C.

Jay, Zackary J.↗

A Comprehensive Calibration Framework for the Northwest River Forecast Center

We present a comprehensive framework developed by the Northwest River Forecast Center for calibrating hydrologically diverse basins. The framework includes models for snow, soil moisture, routing, channel loss, and consumptive use. Data inputs include a wide range of open-access datasets for meteorology, land use, topography, and land cover. The framework uses conceptual hydrologic models to handle basins with various hydrologic regimes including rain-driven and snowmelt-dominated basins. We also develop a flexible automatic calibration system that can handle numerous unobservable model parameters in a computationally efficient manner. A single-basin automatic calibration run can typically be completed on a modern laptop in under 10 min. We found that model performance metrics for this new approach match the quality of the NWRFC's previous labor-intensive manual calibrations. The model performance also rivals that of a state-of-the-art deep learning model at a fraction of the computational cost. This framework presents a new standard for the quality of calibrations possible with lumped conceptual hydrologic models, combining careful data curation, an objective calibration framework, and expert local knowledge. In addition, we have made software packages available for the entire suite of National Weather Service River Forecast System models, including SAC-SMA, SNOW-17, and Lag-K. These modern interfaces are intended to increase accessibility and facilitate future research.

Forecasting↗

Assessing biogeographic survey gaps in bacterial diversity knowledge: A global synthesis of freshwaters

Freshwaters account for 0.8% of Earth's surface area, yet support >10% of known plant and animal species making them disproportionately biodiverse. Modern molecular techniques have begun to reveal microbial diversity, but application of these approaches to address global microbial biogeography is relatively unknown in freshwaters. Our aim was to identify gaps in microbial data coverage along climatic and landscape disturbance gradients and among terrestrial biomes and hydrographic regions for all freshwater ecosystems and three freshwater habitat types: lakes and reservoirs (lentic); streams and rivers (lotic); and wetlands. We reviewed literature on microbial diversity in freshwaters surveyed using 16S ribosomal RNA sequencing which identify microbial taxa. We georeferenced survey locations and used a geographic information system to identify and map gaps in survey coverage using open-source data for climate, landscape disturbance, terrestrial biomes, and freshwater ecoregions. In our study, we compiled 3,425 georeferenced survey locations reported from 963 studies. Streams were surveyed most frequently (60.8% of survey locations), followed by lakes (33.5%) and wetlands (5.6%). Surveys were concentrated in North America, central and western Europe, and Southeast Asia; 35% of freshwater ecoregions were surveyed at least once across freshwater habitat types, whereas 23%, 23%, and 12% were surveyed at least once for lentic, lotic, and wetland habitat types, respectively. The climatic gap analysis indicated coverage is high for temperate regions but lacking in the tropics and Arctic, particularly for wetland ecosystems. Our assessment revealed high climatic coverage of freshwater microbial diversity knowledge, but expansive ecoregional gaps attributable to biased sampling near research institutions in North America, western Europe, and China. Future surveys should target ecoregions in Africa, South America, Central Asia, Australia, and Antarctica. An essential next step will be to curate and disseminate sequencing efforts to facilitate the study of processes driving global diversity patterns.

16S rRNA↗

Global root traits (GRooT) database

Motivation: Trait data are fundamental to the quantitative description of plant form and function. Although root traits capture key dimensions related to plant responses to changing environmental conditions and effects on ecosystem processes, they have rarely been included in large-scale comparative studies and global models. For instance, root traits remain absent from nearly all studies that define the global spectrum of plant form and function. Thus, to overcome conceptual and methodological roadblocks preventing a widespread integration of root trait data into large-scale analyses we created the Global Root Trait (GRooT) Database. GRooT provides readyto- use data by combining the expertise of root ecologists with data mobilization and curation. Specifically, we (a) determined a set of core root traits relevant to the description of plant form and function based on an assessment by experts, (b) maximized species coverage through data standardization within and among traits, and (c) implemented data quality checks. Main types of variables contained: GRooT contains 114,222 trait records on 38 continuous root traits. Spatial location and grain: Global coverage with data from arid, continental, polar, temperate and tropical biomes. Data on root traits were derived from experimental studies and field studies. Time period and grain: Data were recorded between 1911 and 2019. Major taxa and level of measurement: GRooT includes root trait data for which taxonomic information is available. Trait records vary in their taxonomic resolution, with subspecies or varieties being the highest and genera the lowest taxonomic resolution available. It contains information for 184 subspecies or varieties, 6,214 species, 1,967 genera and 254 families. Owing to variation in data sources, trait records in the database include both individual observations and mean values. Software format: GRooT includes two csv files. A GitHub repository contains the csv files and a script in R to query the database.

59 BASIC BIOLOGICAL SCIENCES↗

Atomistic Simulation of Glasses and Amorphous Materials: Challenges and Opportunities for the Next Decade

Atomistic simulations have become indispensable tools for understanding glass structure, dynamics, and properties, yet persistent challenges limit their predictive power. This perspective examines three interconnected issues, namely glass formation procedures, interatomic potential development, and machine learning applications, which emerged from the 5th International Workshop on Challenges of Atomistic Simulations of Glasses and Amorphous Materials. We identify convergent community priorities for (i) standardized validation protocols, (ii) curated benchmark datasets with complete metadata, and (iii) open repositories for glasses. A systematic was forward is provided by a hierarchical validation framework for assessing the structural fidelity, property prediction, and behavioral realism of simulation techniques. Looking ahead, transformative advances are promised by the fusion of classical techniques with machine learning based approaches, for instance, by integrating swap Monte Carlo with machine-learning (ML) potentials, leveraging foundation models through transfer learning, and finetuning ML potentials with experimental data. Progress depends on the community committing to validated models, reproducible protocols, and sustained data sharing.

Krishnan, N. M. Anoop↗

Plant defensin MtDef4–derived antifungal peptide with multiple modes of action and potential as a bio–inspired fungicide

Chemical fungicides have been instrumental in protecting crops from fungal diseases. However, increasing fungal resistance to many of the single-site chemical fungicides calls for the development of new antifungal agents with novel modes of action (MoA). The sequence-divergent cysteine-rich antifungal defensins with multisite MoA are promising starting templates for design of novel peptide-based fungicides. Here, we experimentally tested such a set of 17-amino-acid peptides containing the γ-core motif of the antifungal plant defensin MtDef4. These designed peptides exhibited antifungal properties different from those of MtDef4. Focused analysis of a lead peptide, GMA4CG_V6, showed that it was a random coil in solution with little or no secondary structure elements. Additionally, it exhibited potent cation-tolerant antifungal activity against the plant fungal pathogen Botrytis cinerea, the causal agent of grey mould disease in fruits and vegetables. Its multisite MoA involved localization predominantly to the plasma membrane, permeabilization of the plasma membrane, rapid internalization into the vacuole and cytoplasm, and affinity for the bioactive phosphoinositides phosphatidylinositol 3-phosphate (PI3P), PI4P, and PI5P. The sequence motif RRRW was identified as a major determinant of the antifungal activity of this peptide. While topical spray application of GMA4CG_V6 on Nicotiana benthamiana and tomato plants provided preventive and curative suppression of grey mould disease symptoms, the peptide was not internalized into plant cells. Our findings open the possibility that truncated and modified defensin-derived peptides containing the γ-core sequence could serve as promising candidates for further development of bio-inspired fungicides.

54 ENVIRONMENTAL SCIENCES↗

Database of low‐temperature absorption and fluorescence spectra of native photosynthetic tetrapyrrole macrocycles

Low-temperature (77 K) absorption and fluorescence spectra of 12 naturally occurring photosynthetic tetrapyrrole macrocycles have been recorded in a frozen glass (2-methyltetrahydrofuran). The compounds encompass distinct chromophore classes: porphyrin, chlorophyll c 2 ; chlorin, chlorophylls a, b, d, f and bacteriochlorophylls c, d, e, f; and bacteriochlorin, bacteriochlorophylls a, b, g. The spectra are compared with those of the same pigment in liquid solution (predominantly 2-methyltetrahydrofuran) at room temperature (293 K). The measured Stokes shifts at 77 K across the 12 macrocycles range from ~30 to 300 cm −1 . The spectral data in digital form are made available as part of the PhotochemCAD databases. Literature searches have revealed extensive published data for Chl a (often in biological matrices) but at best rather limited data for less common macrocycles. The availability of a systematic collection of curated spectral data collected at low temperature should be useful for a variety of assessments, including reconstruction of absorption spectra of (bacterio)chlorophyll-containing protein complexes, vibrational analysis of absorption and fluorescence spectra, and calculations where knowledge of energy levels is important.

Niedzwiedzki, Dariusz M. [Washington University in↗

Large-scale atlas of microarray data reveals the distinct expression landscape of different tissues in Arabidopsis

Here, transcriptome datasets from thousands of samples of the model plant Arabidopsis thaliana have been collectively generated by multiple individual labs. Although integration and meta-analysis of these samples has become routine in the plant research community, it is often hampered by the lack of metadata or differences in annotation styles by different labs. In this study, we carefully selected and integrated 6,057 Arabidopsis microarray expression samples from 304 experiments deposited to NCBI GEO. Metadata such as tissue type, growth condition, and developmental stage were manually curated for each sample. We then studied global expression landscape of the integrated dataset and found that samples of the same tissue tend to be more similar to each other than to samples of other tissues, even in different growth conditions or developmental stages. Root has the most distinct transcriptome compared to aerial tissues, but the transcriptome of cultured root is more similar to those of aerial tissues as the former samples lost their cellular identity. Using a simple computational classification method, we showed that the tissue type of a sample can be successfully predicted based on its expression profile, opening the door for automatic metadata extraction and facilitating re-use of plant transcriptome data. As a proof of principle we applied our automated annotation pipeline to 708 RNA-seq samples from public repositories and verified accuracy of our predictions with samples’ metadata provided by authors.

59 BASIC BIOLOGICAL SCIENCES↗