Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “language models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

952 records · Page 53

The Accelerator Neutrino Neutron InteractionExperiment: Design, Construction and Preparationfor First Physics

This thesis covers work performed for the Accelerator Neutrino Neutron Interaction Experiment (ANNIE) between 2015 and 2020. ANNIE is a beamline neutrino experiment located at the Fermi National Accelerator Laboratory in Chicago. Its primary physics goals are the measurement of neutrino interaction cross-sections on oxygen, and a measurement of the multiplicity of final state neutrons from these interactions, both as functions of final state kinematics. In order to achieve these goals ANNIE will be pioneering the use of Large Area Picosecond Photodetectors and the use of gadolinium doping to enhance neutron visibility in a water Cherenkov detector. Over the time period of this thesis the ANNIE detector was constructed, an initial 'Phase I' background run was completed, the detector was decommissioned and then substantially upgraded in preparation for the main 'Phase II' physics run. At the time of writing ANNIE is being re-commissioned, with Phase II data taking anticipated to begin in 2021. During this time I spent 21/2 years on-site contributing to almost all aspects of hardware work, while performing software development for the simulation and analysis frameworks. As my first software task I developed Monte Carlo simulations of the detector response, based on the WCSim framework. While thismore » framework provided a starting point for the tank simulation significant modifications were required to implement the complete ANNIE detector system. This included a rewrite of the geometry, along with modifications to the photosensor definitions, hit collections, digitization, triggering, input and output interfaces, etc. To take advantage of improved modelling of neutrons in Geant4.10 the physics lists were also reimplemented in the new version format. As part of this work I determined performance metrics based on the output files, calculating kinematic acceptance, detector efficiency and expected event rates. My contributions on reconstruction focused primarily on the MRD, for which I implemented two track reconstruction algorithms, specialised for high and low energy muons. The high energy algorithm achieves >90% efficiency for tracks with at least 8 hits, and is robust against dead paddles and unrelated hits. The low energy algorithm performs a search in combination with tank information to provide sensitivity down to a single MRD hit. Early data handling work for the Phase I background run included writing the code for handling TDC hits and performing studies on neutron detection without the requirement of multi-hit coincidence. As the collaboration moved to a new framework for the Phase II analysis I performed a substantial amount of work to develop the codebase, implementing tools to perform tasks such as file IO, data parsing, waveform processing, event building, timestamp alignment, time clustering, hit residual calculation, event visualisation etc. I helped develop the python API for integrating multi-language tools, and ported the framework into a Singularity container to provide a self-contained environment that…« less

43 PARTICLE ACCELERATORS↗

Digital Analytics, Causal Knowledge Acquisition and Reasoning for Technical Language Processing

Complex engineering systems such as nuclear power plants (NPPs) generate and collect large amounts of equipment reliability (ER) data elements that contain information on the status of components, assets, and systems. Some of this information is textual in form and can be found in documents such as incident reports (IRs) and work orders (WOs). Analyses of textual data in current NPPs-using natural language processing (NLP) methods-have been expanded over the last decade, and it is only recently that the true potential of such analyses has emerged. So far, applications of NLP methods have mostly been limited to classification and prediction, the goal being to identify the nature of the textual element (e.g., safety or non-safety related). Here, we target a more complex problem: automatically extracting knowledge from a textual element in order to assist system engineers in conducting system health assessments. Knowledge extraction is a very broad concept, and its definition may vary depending on the application context. Our methods are a blend of both rule-based and machine learning (ML) algorithms. For our purposes, knowledge extraction means identifying the systems or assets mentioned in a given textual element, as well as the type of event described (e.g., component failure or maintenance activity). In addition, we want to capture details such as measured quantities and the temporal/cause-effect relations between events. In this tool, we also demonstrate how textual data elements are preprocessed in order to handle typos, acronyms, and abbreviations. One main feature of these methods is that they are not based solely on data, but are in fact model-based. In other words, they also rely on MBSE models that are designed to capture-from a functional point of view-the architecture of the systems/assets under consideration. The main purpose of such models is to digitally emulate system engineers' knowledge of system and asset architecture and to identify dependencies among systems, assets, and components. Provided these models, analyses of textual and numeric ER data can be performed by first identifying the OPM model elements to which the ER data elements are referring. The relationships between ER data elements are then identified by checking for any temporal or logical dependencies.

Mandelli, Diego [Idaho National Laboratory (INL), ↗

Understanding EV Charging Pain Points Through Deep Learning Analysis

Current and potential electric vehicle (EV) owners express concerns about the charging infrastructure, mentioning non-functional chargers, prolonged charging times, inconvenient charger locations, long wait times, and high costs as major barriers. Addressing these issues often requires analyzing actual vehicle charging data, which is typically proprietary and inconsistent due to diverse standards and protocols. To understand and improve the EV charging experience, customer reviews are typically used to identify common customer pain points (CPPs). However, there is not a comprehensive method to map customer reviews to a standardized set of CPPs. In collaboration with the National Charging Experience (ChargeX) Consortium, this study bridges these gaps by proposing a Systematic Categorization and Analysis of Large-scale EV-charging Reviews (SCALER) framework. SCALER is an integrated, deep learning framework that segments, actively labels, analyzes, and classifies EV charging customer reviews into six CPP categories. To test its effectiveness, we used SCALER to analyze over 72,000 reviews from customers charging various EV models on different networks across the United States. SCALER achieves a classification accuracy of 92.5%, with an F1 score exceeding 85.7%. By demonstrating real-world applications of SCALER, we enhance the industry’s ability to understand and address CPPs to improve the EV charging experience.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗

Relative reproductive phenology and synchrony affect neonate survival in a nonprecocial ungulate

Abstract Degree of reproductive synchronization in prey is hypothesized as a predator defense strategy reducing prey risk via predator satiation or predator avoidance. Species with precocial young, especially those exposed to specialist predators, should be highly synchronous to satiate predators (predator satiation hypothesis), while prey with nonprecocial (i.e. altricial) young, especially those exposed to generalist predators, should become relatively asynchronous to avoid predator detection (predator avoidance hypothesis). The white‐tailed deer Odocoileus virginianus in North America is an example of a nonprecocial ungulate that uses the hider strategy early in life; its primary predator (coyote; Canis latrans ) is a generalist, making white‐tailed deer a good model species to test the predator avoidance hypothesis. We used birth dates and known fates of white‐tailed deer neonates ( n = 1,032) across nine study sites varying in relative synchrony and predator assemblages to test the predator avoidance hypothesis. We predicted that relative birthing asynchrony of the population would increase relative survival at the population level; therefore, at the individual scale, neonate birth date nearer to mean birthing date in a respective population would not influence individual survival. Coyotes were responsible for the majority of predation events, and survival of those neonates increased the closer the individual was born to peak birthing season in each respective population. Also, at the population level, reproductive asynchronization negatively affected survival. Contrary to the predator avoidance hypothesis, our data indicate patterns in neonate survival for white‐tailed deer better support the predator satiation hypothesis at the individual and population level. Additionally, coyotes may present a selective force great enough to shift reproductive synchrony such that predator satiation may become a feasible defense strategy for neonates at local spatial scales. Our results indicate that synchronizing reproduction may still be the most effective strategy to reduce individual predation risk from generalist predators, particularly when the window of heightened resource availability to the prey is narrow. A free Plain Language Summary can be found within the Supporting Information of this article.

Michel, Eric S.↗

Data from: "Warming and provenance limit tree recruitment across and beyond the elevation range of subalpine forest"

This data package contains data used to support conclusions drawn in “Warming and provenance limit tree recruitment across and beyond the elevation range of subalpine forest”, by Kueppers et al. 2017. Data were collected in field sites within the Alpine Treeline Warming Experiment (ATWE), located on Niwot Ridge, on the eastern slope of the Colorado Rocky Mountains, USA. Files containing geospatial data are also included, to provide additional locational context.There are four document formats associated with this archive: three comma-separated values (.csv) files, three Microsoft Excel (.xlsx) files, one .pdf data user’s guide, four keyhole markup language (.kml) files, and a compressed folder containing seven ESRI shapefiles (.shp). The .csv files can be opened using any simple text-editor software, R, or Microsoft Excel. The .xlsx files can only be opened using Microsoft Excel. The .kml file can be opened by Google Earth and Google Maps, and the shapefiles can be opened with any GIS application compatible with the file type, such as ESRI’s ArcGIS, and QGIS.We provide two versions of the seedling data file: “PIEN_PIFLseedlings20150522_20150525rev12222020.csv/.xlsx” (hereafter PIEN_PIFLseedlings2015) and “PIEN_PIFLseedlings20160408rev12222020.csv/.xlsx” (hereafter PIEN_PIFLseedlings2016). PIEN_PIFLseedlings2015 contains the data we used in the paper. PIEN_PIFLseedlings2016 contains an updated version of these data that includes sampling from later years. The main differences between the two files lie in the columns titled “k[YEAR],” which describe the number of seedlings that were killed in a particular year. In PIEN_PIFLseedlings2016, there also is an additional year of data for k2015, and k2014 also has additional data input for the 2014 cohort. Additionally, in years 2010-2014, there are minor differences in the number of seedlings killed -- in as few as 0 plots (in 2011) to as many as 5 plots (in 2014) -- due to errors in data input that were rectified in later years.------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Upslope range shifts by subalpine tree species are a widely anticipated effect of climate change. Climate niche models predict subalpine forests to expand upslope, given more suitable growing conditions for adult trees. However, these models do not take into account climates required for successful seedling recruitment and establishment, an essential element for expansion. Further, localized upper treeline populations are hypothesized to contain favorable traits for colonizing the alpine. To test these expectations and to expand our knowledge of seedling recruitment under climate change, we designed a common garden, climate-warming experiment spread across an elevation gradient at Niwot Ridge in the Colorado Rocky Mountains. We focus on two widespread Western North American species, Engelmann spruce (Picea engelmannii Parry ex. Engelm) and limber pine (Pinus flexilis James), which occur at treeline. While the former is considered a late-seral species more tolerant of shade, limber pine is a shade-intolerant pioneer species able to establish on infertile sites.Every autumn, seeds of the two species were collected from high- (3370 m–3570 m) and low-provenance (2910–3240 m) sources close to the experimental sites and sown in our plots. A subset of plots were heated and another subset watered over the summer months to offset the effects of warming. Across five years, we found that seeds originating from low elevation recruited more strongly for both species, although this provenance difference diminished by the fourth year for Engelmann spruce, likely due to small sample sizes. Despite the recruitment of low-provenance seed, warming treatments decreased recruitment at all elevations. Combining this with the likeliness and availability of lower-quality, high provenance seed moving upslope at the treeline, tree migration into the alpine may be slowed. Overall, our findings suggest that the hardier limber pine is likely to become a more significant species in subalpine forest communities in the future, while the more sensitive Engelmann spruce may experience range contraction.

54 ENVIRONMENTAL SCIENCES↗

On the Language of Reliability: A System Engineer Perspective

In its classical definition, risk is defined by three elements: what can go wrong, what are its consequences, and how likely is it to occur? While this definition makes sense in a regulatory-based framework where for the current fleet of operating light water reactors (LWRs), the risks associated with nuclear power plants typically are characterized in terms of core damage and large early release frequency (LERF), this approach does not provide a useful snapshot of the health of the plant from a broader perspective. This is due to the very narrow context in which the term “risk” typically is defined as nuclear safety aspects that have the potential to impact public health. In this paper, we take the viewpoint of nuclear safety that is reflective of the current fleet of operating LWRs for which core damage frequency and LERF are appropriate metrics. For other advanced reactor designs, other more applicable technology neutral metrics of reactor safety metrics would be specified. A possible alternate path would start by redefining the word risk with a broader meaning that better reflects the needs of a system health and asset management decision-making process. Rather than asking how likely an event could occur (in probabilistic terms), we can ask how far this event is from occurring. Our approach starts by defining and quantifying component and system health in terms of a “distance” between its actual and limiting conditions, i.e., determination of the margin that exists between the current state/condition and the state where the component/system is no longer capable of achieving its intended function. A margin is a measure that is more reflective of the current state or performance of a component, and therefore more closely tied to decisions that are made on an ongoing basis. Further, we will show how, given the data available from plant equipment reliability and monitoring (e.g., pump vibration data) and prognostic (e.g., component remaining useful life estimation) data, a margin can be described and determined for all types of maintenance approaches (e.g., corrective or predictive maintenance). We show how classical reliability models (e.g., fault trees) can be used to quantify the system margin provided component margin values. In the approach described in this paper, the propagation of margin values through classical reliability models are not performed using classical probabilistic calculations applied to sets (as performed in a typical plant probabilistic risk assessment). Instead, we show how it is possible to propagate margin values through Boolean logic gates (i.e., AND and OR operators) through distance-based operations.

97 MATHEMATICS AND COMPUTING↗

Waveguides for neurostimulation in the cochlea

Introduction Optical stimulation has been suggested for neural stimulation to improve cochlear implants. Light allows for more spatially selective activation of neuron populations than electrical current, offering more independent frequency bands along the spiral ganglion. These bands are available to encode acoustic information with anticipated better frequency resolution, improving cochlear implant user performance in noisy listening environments, tonal languages, and music perception. Methods Optical cochlear implants (oCIs) can deliver light either directly via small emitters within the cochlea or via waveguides from external optical sources. We investigated three waveguide designs made from OrmoComp ® , a polymer that cures through ultraviolet (UV) radiation. Waveguides were fabricated via injection molding and coated using dip-coating or thermal reflow, or through aspiration of OrmoComp ® into polyimide tubing that served as the cladding of the waveguide. The choice of fabrication technique directly determined the waveguides' total diameter: thermal reflow yielded ≈940 μm, dip-coating produced ≈306 μm, and aspiration resulted in ≈132 μm core diameter waveguides. Given the human cochlea's small size, we focused on analyzing the 306-μm and 132-μm waveguides, evaluating their optical performance (propagation and bending losses) and mechanical properties (bending stiffness and insertion forces). Furthermore, we evaluated some of these designs in in-vivo guinea pigs experiments. Results For the 100-μm core diameter waveguides, the propagation losses were 12.34 ± 1.26, 1.18 ± 0.88, 1.49 ± 0.58, and 3.43 ± 0.68 dB/cm at 534, 1,375, 1,460, and 1,550 nm, respectively. The respective bending losses at a 2 mm radius of curvature were 5.50 ± 1.32, 0.56 ± 0.26, 0.79 ± 0.18, and 0.64 ± 0.23 dB, and at 1 mm 8.54 ± 1.30, 2.05 ± 0.84, 2.11 ± 0.50, and 1.44 ± 0.37 dB. The bending stiffness of a 1 mm segment of the 100-μm-diameter waveguides was 18.9 ± 2.2 N/m. Insertion forces for the 100-μm-diameter waveguides into an acrylic human-size scala tympani model were < 25 mN. For the waveguides with 306 and 940 μm total diameter, the propagation losses ranged between 0.43 and 2.40 dB/cm at 534, 680, 1,375, and 1,550 nm, between 2.19 and 3.78 dB/cm at 450 and 1,460 nm. Bending losses for 360 degrees at 1,375 nm were 5.0, 2.4, and 0.46 for a bending radius of 2.5-, 3-, and 4-mm. Discussion Our study demonstrated that the polymer OrmoComp ® is suitable for fabricating waveguides to transmit near-infrared radiation. In-vivo experiments showed optically evoked auditory responses originating from optical stimulation in the guinea pigs' first cochlear turn while radiation was delivered. Incoming experiments will focus on evaluating long-term performance of these waveguides in guinea pigs and cats. This study will be designed to provide insights into the waveguides' performance and biocompatibility over extended periods, essential for their potential clinical application in future oCIs.

Kim, Matthew↗

Learning to Rank in the Age of Muppets: Effectiveness–Efficiency Tradeoffs in Multi-Stage Ranking

It is well known that rerankers built on pretrained transformer models such as BERT have dramatically improved retrieval effectiveness in many tasks. However, these gains have come at substantial costs in terms of efficiency, as noted by many researchers. In this work, we show that it is possible to retain the benefits of transformer-based rerankers in a multi-stage reranking pipeline by first using feature-based learning-to-rank techniques to reduce the number of candidate documents under consideration without adversely affecting their quality in terms of recall. Applied to the MS MARCO passage and document ranking tasks, we are able to achieve the same level of effectiveness, but with up to 18 increase in efficiency. Furthermore, our techniques are orthogonal to other methods focused on accelerating transformer inference, and thus can be combined for even greater efficiency gains. A higher-level message from our work is that, even though pretrained transformers dominate the modern IR landscape, there are still important roles for “traditional” LTR techniques, and that we should not forget history.

catalysis↗

Autonomous sputter synthesis of thin film nitrides with composition controlled by Bayesian optimization of optical plasma emission

Autonomous experimentation has emerged as an efficient approach to accelerate the pace of material discovery. Although instruments for autonomous synthesis have become popular in molecular and polymer science, solution processing of hybrid materials, and nanoparticles, examples of autonomous tools for physical vapor deposition are scarce yet important for the semiconductor industry. Here, we report the design and implementation of an autonomous workflow for sputter deposition of thin films with controlled composition, leveraging a highly automated sputtering reactor custom-controlled by Python, optical emission spectroscopy (OES), and a Bayesian optimization algorithm. We modeled film composition, measured by x-ray fluorescence, as a linear function of plasma emission lines monitored during co-sputtering from elemental Zn and Ti targets in an N 2 and Ar atmosphere. A Bayesian control algorithm, informed by OES, navigates the space of sputtering power to fabricate films with user-defined compositions by minimizing the absolute error between desired and measured optical emission signals. We validated our approach by autonomously fabricating Zn x Ti 1-x N y films that deviate from the targeted cation composition by a relative ±3.5%, even for 15 nm thin films, demonstrating that the proposed approach can reliably synthesize thin films with a specific composition and minimal human interference. Moreover, the proposed method can be extended to more difficult synthesis experiments where plasma intensity lines depend non-linearly on pressure, or the elemental sticking coefficients strongly depend on the substrate temperature.

36 MATERIALS SCIENCE↗

HIPLZ: Enabling performance portability for exascale systems

While heterogeneous computing has emerged as a dominant trend in current and future High-Performance Computing (HPC) systems, it is also widely recognized that this shift has led to increased software complexity due to a proliferation of programming systems for different heterogeneous processors. One such example is the Heterogeneous-Compute Interface for Portability from AMD (HIP ), which is composed of a C Runtime API and C++ Kernel Language. Many HPC applications will likely use HIP on future exascale systems (e.g., Frontier and El Capitan), but HIP currently only targets AMD and NVIDIA processors. This limitation creates challenges for users who would also like to run their applications on exascale systems based on other architectures (e.g., Aurora, which is based on Intel hardware) that are currently not targeted by HIP . In this paper, we introduce the design and implementation of HIPLZ , a compiler and runtime system that uses the Intel Level Zero API to support HIP on Intel GPU architectures. We discuss the design of HIPLZ , derived from HIPCL (an implementation of HIP on top of OpenCL ), and portability issues that occur from using the Level Zero runtime as a backend. We evaluate our implementation by running several performance benchmarks and mini-apps written in HIP on Intel architectures using HIPLZ . Our results show that this approach provides competitive performance relative to Intel's OpenCL implementations on Intel Gen9 and UHD Graphics 770 GPUs, while providing good coverage of features needed by HPC applications. Overall, this approach is a promising demonstration of enabling performance portability for exascale systems.

97 MATHEMATICS AND COMPUTING↗

Machine-Learning-Based Mapping and Modeling of Solar Energy with Ultra-High Spatiotemporal Granularity

Despite the rapid growth of solar energy, we still lack a dynamic, high-fidelity database that tracks the spatiotemporal variations of solar PVs and their associated infrastructures across different places at a spatially resolved scale. The absence of such data presents a barrier to various applications such as solar PV growth projection, solar energy integration, solar incentive design, and climate risk assessment. In this project, we aim to bridge this gap by developing AI-based algorithms to extract granular information about solar PV installations and their associated infrastructures (i.e., distribution grids) from widely available unstructured data like remote sensing images and street views. As a result, we have built the Solar Energy Atlas, a fine-grained, large-scale geospatial overlay of distributed solar PVs and distribution grids. On top of it, we have advanced the understanding of solar adoption and distribution grid vulnerability to climate-induced extremes. Our major contributions can be summarized as follow: (1) By developing new AI algorithms, we have built the most comprehensive solar PV spatiotemporal database covering the entire US. This is the first time we obtained the exact GPS locations, size, subtype, and installation year information for rooftop solar PVs across the US. This database can be used for solar PV growth projection, solar energy integration, solar energy policy analysis and design, and spatially-resolved climate risk assessment. (2) Leveraging this database, we have uncovered the socioeconomic driving factors that are correlated with earlier onset of solar adoption and higher saturated adoption levels. We have identified the heterogeneity in the effects of different types of financial incentives on solar adoption and provided implications for tailoring incentive design based on local income levels to promote equitable solar adoption. (3) We have developed a distribution grid GIS mapping algorithm which can obtain granular geospatial and topology information about distribution grids using multi-modal open data, reducing the dependency on hard-to-obtain smart meter data of conventional approaches. It shows effectiveness in both the U.S. and Sub-Saharan Africa. Using this algorithm, we have uncovered the non-uniform vulnerability of distribution grids to wildfires in California in the aspects of undergrounding protection and Distributed Energy Resources (DER) preparedness. This has provided important implications for improving the affordability and equity of grid adaptation approaches. (3) We have made our produced database publicly available and provided user-friendly interface to enable various stakeholders and the general public to interact with the data. We have also integrated the produced data into the Data Commons platform to enable the public to access the data and correlate it with other location-specific characteristics simply using natural language as queries. The impact of our project is three-fold: (1) New algorithms for mapping solar PVs and distribution grids across space and time, which are open source to facilitate researchers and industry; (2) New databases of solar PVs and distribution grids that have been made publicly available for engineering, social, and policy applications; (3) New understandings and actionable insights on the potential approaches to promoting solar adoption and reducing energy infrastructure vulnerabilities. In this report, we start by discussing the project background and motivation (section 5), followed by the overview of project objectives (section 6). Results and discussion for each task are presented in section 7. Significant accomplishments are summarized in section 8. This report will be concluded by discussing the paths forwards (section 9), products (section 10), and team roles (section 11).

14 SOLAR ENERGY↗

Data from: "Warming and the dependence of limber pine (Pinus flexilis) establishment on summer soil moisture within and above its current elevation range"

This data package contains data that were used for analysis in “Warming and the dependence of limber pine (Pinus flexilis) establishment on summer soil moisture within and above its current elevation range”, by Moyes et al. 2013. All data collection and field research were completed on Niwot Ridge, Colorado, USA.This data package contains nine comma-separated-values (.csv) files, one text (.txt) file, and two zipped seedling folders that were used for leaf area analysis. One zipped folder contains 468 .jpg photographs of seedlings, and the second contains 468 corresponding Image J-processed .jpg images that include silhouette leaf area values. .csv and .txt files can be opened using any compatible simple text-editor software such as TextEdit (Mac) and Notepad (Windows); .csv’s can also be opened using R and Microsoft Excel. Image files can be opened using Preview (Mac) and Photos (Windows). In addition, there are a total of 31 Microsoft Excel files: three .xlsx files, and 28 raw Li-Cor output .xls files. This data user’s guide is available in .pdf format, and can be opened using Adobe Acrobat Reader, or any other compatible file viewing software. Geospatial data showing field site locations are also included in the archive for use and reference. There are two geospatial formats in this archive: ESRI shapefiles (.shp) and keyhole markup-language (.kml) files. Both file types contain bounding box information, with the former being polygons, and the latter containing corner coordinates for each site. ESRI shapefiles can be opened using any geospatial software compatible with the file type (such as ESRI’s ArcGIS suite and QGIS), and .kml files are compatible with Google Earth and Google Maps.--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Continued changes in climate are projected to alter the geographic distributions of plant species, in part by affecting where individuals can establish from seed. We tested the hypothesis that warming promotes uphill redistribution of subalpine tree populations by reducing cold limitation at high elevation and enhancing drought stress at low elevation. We seeded limber pine (Pinus flexilis) into plots with combinations of infrared heating and water addition treatments, at sites positioned in lower subalpine forest, the treeline ecotone, and alpine tundra. In 2010, first-year seedlings were assessed for physiological performance and survival over the snow-free growing season. Seedlings emerged in midsummer, about 5–8 weeks after snowmelt. Low temperature was not observed to limit seedling photosynthesis or respiration between emergence and October, and thus experimental warming did not appear to reduce cold limitation at high elevation. Instead, gas exchange and water potential from all sites indicated a prevailing effect of summer moisture stress on photosynthesis and carbon balance. Infrared heaters raised soil growing degree days (base 5 °C, p < 0.001) and August–September mean soil temperature (p < 0.001). Despite marked differences in vegetation cover and meteorological conditions across sites, volumetric soil moisture content (θ) at 5–10 cm below 0.16 and 0.08 m^3 m^(−3) consistently corresponded with moderate and severe indications of drought stress in midday stem water potential, stomatal conductance, photosynthesis, and respiration. Seedling survival was greater in watered plots than in heated plots (p = 0.01), and negatively related to soil growing degree days and duration of exposure to θ < 0.08 m^3 m^(−3) in a stepwise linear regression model (p < 0.0001). We concluded that seasonal moisture stress and high soil surface temperature imposed a strong limitation to limber pine seedling establishment across a broad elevation gradient, including at treeline, and that these limitations are likely to be enhanced by further climate warming.--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------Maintenance log:Amended file name error in Data User's Guide May 19 2022

54 ENVIRONMENTAL SCIENCES↗

Machine Learning Modeling Pipeline for Extracting Nuclear Proliferation Events of Interest from Open Data Sources (U)

In FY2020, the Savannah River National Laboratory (SRNL) and the Sanghani Center for Artificial Intelligence and Data Analytics at Virginia Polytechnic Institute and State University entered a collaboration funded by Department of Energy’s (DOE) Office of Defense Nuclear Nonproliferation Research and Development. The project’s mission was to take the first steps toward developing a demonstration prototype system that uses multiple machine learning and data analytics methods on largescale open data sources to identify new, developing, and/or undeclared nuclear programs. Given the SRNL team’s on-site perspective of events culminating in the DOE’s decision to pursue the Savannah River Plutonium Processing Facility (SRPPF), the team targeted the identification of events and indicators in retrospective datasets that pointed to the activity of “fissile core fabrication at the Savannah River Site” prior to the official announcement in May of 2018. A preliminary modeling pipeline was developed in FY20 that showed the datasets contained adequate signal for continuation of efforts. In FY21, a modular demonstration prototype modeling pipeline has continued in development for two text-based data sources: a broad internet archive (Webhose Ltd.) and a decahose Twitter database (i.e., a global sampling of one in every ten Tweets). The techniques that have been developed rely on graph theory and anomaly detection to identify contextual shifts in key words and phrases at various points in time such that indicators of events of interest could be identified and subsequently, events could be extracted from the corpuses. The foundational concept behind the approaches is that contextual shifts in key words and phrases can act as indicators of events of interest. Both datasets have proven successful in extracting events of interest related to pit production at the Savannah River Site prior to the official announcement. In addition, the pipelines have generated a wide range of events broadly summarized as: the awarding of DOE contracts at major sites, DOE investments in various programs, accidents at DOE national laboratories, speculations about the fate of pit production in the DOE complex, domestic and international shipments and receipts of nuclear materials at DOE sites, termination of non-proliferation agreements with Russia, termination of MOX, new weapons development approvals/testing, nuclear posture reviews, major DOE cleanup/production milestones, political opinions, and nuclear watch groups’ opinions, among many others.

97 MATHEMATICS AND COMPUTING↗

The Role of Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology: Proceedings of a Workshop

Quantum concepts hold the potential to enable significant advances in sensing and imaging technologies that could be vital to the study of biological systems. The workshop Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology, held online March 8–10, 2021, was organized to examine the research and development needs to advance biological applications of quantum technology. Hosted by the National Academies of Sciences, Engineering, and Medicine, the event brought together experts working on state-of-the-art, quantum-enabled technologies and scientists who are interested in applying these technologies to biological systems. Through talks, panels, and discussions, the workshop facilitated a better understanding of the current and future biological applications of quantum-enabled technologies in fields such as microbiology, molecular biology, cell biology, plant science, mycology, and many others. The workshop was organized around three main themes. The first, quantum in biology, examined quantum concepts that are hypothesized to be important for life processes and that researchers are working to observe through biological imaging and sensing. The second, quantum for biology, addressed ways to use quantum concepts to enhance technologies for biological imaging and sensing. The third, biology for quantum, offered a wider discussion of how the frontiers of biological imaging and sensing could enable future study using quantum concepts, tools, or technologies. Throughout the workshop, participants identified a wide range of emerging approaches and opportunities at the intersection of quantum physics and biological sensing and imaging. During the workshop, there were some differences in how each speaker defined the term quantum. During one of the panels, Prem Kumar offered thoughts on what phenomena are classical versus quantum, explaining that techniques get progressively more quantum as you move from just having superposition to having superposition with measurement and entanglement. Another explanation from Clarice Aiello delineates the definition into several levels. This includes a base level of “quantum-ness,” which reflects that all matter is made of atoms, and when these particles are isolated they behave based on quantum mechanical principles. A second level is related to quantum coherence, where a single quantum object might be found in a coherent superposition state. A final level, which she described as the quantum-entangled level, involves multiple quantum systems which are entangled among themselves. Overall, the workshop touched on concepts such as superposition, entanglement, and squeezing and their potential implications for communication, computing, and simulation, in addition to the workshop’s main focal area, biological sensing and imaging. At the opening of the workshop, Thorsten Ritz of the University of California, Irvine, identified two questions at the heart of quantum biology: Is the machinery of life quantum mechanical, and can quantum mechanics be used to study the machinery of life in new ways? Participants highlighted systems in which researchers have explored these questions, from the vast array of molecular interactions involved in biological processes such as photosynthesis, to the mechanics involved in cellular functions such as differentiation and aggregation, to the role of oscillating magnetic fields in flight orientation among birds. Sensing and imaging technologies are crucial to biological research; these technologies could both enhance the study of quantum effects and be enhanced by quantum concepts. A critical challenge in biological research is to develop imaging and sensing tools that do not damage or interfere with the often fragile and fleeting systems being studied. Attendees discussed a variety of established and emerging technologies that could enhance noninvasive biological imaging, including single- and two-photon spectroscopy, single-molecule spectroscopy, quantum illumination, ghost imaging, and cryo-electron microscopy. One example came from Marlan Scully who gave a keynote address on the first day of the workshop. Scully emphasized the use of different laser technologies, which exhibit coherence and other quantum properties, in moving toward real-world biological applications, such as the detection of SARS-CoV-2. Both tools and theory will play an important role in advancing quantum biology research and applications. Several participants suggested theorists and experimentalists should work in tandem to understand and model biological processes. While physics often reduces systems to their simplest forms for fundamental insights, participants also noted the value of observing and understanding biological systems in all their “messiness,” capturing both the inner workings of biological systems and the complex interactions that occur within and between organisms. In discussions among participants, several attendees stressed the need to match emerging tools with the right scientific questions. Rather than developing quantum technologies as “a hammer looking for a nail,” participants emphasized a focus on exploring the problems these technologies are best suited to address. For example, it is important to consider the size of the phenomenon being studied, the timescales that are important in answering the scientific question, and other relevant considerations. Every tool along the spectrum from classical to quantum involves its own set of trade-offs. For example, Ted Laurence of the Lawrence Livermore National Laboratory said that quantum measurements, such as single photon counting, fluorescence transitions, and lasers, can take longer to produce the same results as classical measurements. These quantum measurements, however, do not require calibration and can enable new research questions to be answered. Prem Kumar, Northwestern University, noted that, despite their promise, quantum approaches should not be used simply for the sake of using quantum, especially in situations where classical approaches better meet the needs of the researcher. Understanding and applying quantum concepts could enable advances in a wide range of application areas including energy, synthetic biology, medicine, and sustainability. For example, Michelle O’Malley, University of California, Santa Barbara, described how improved noninvasive imaging approaches could help capture the complex interactions and functions involved in the breakdown of organic matter by microbial communities and lead to new technologies for capturing valuable products from plant waste. Several other participants discussed needs in tracking the movement of metabolites and molecules in microbial communities for insights into nutrient cycling in environments such as soil. Margaret Ahmad, Sorbonne University, discussed potential opportunities to leverage the magnetic properties of cryptochromes to advance new treatment approaches for diseases such as COVID-19 and cancer. Looking toward the future development of the field, participants discussed challenges to advancing quantum biology that arise from disciplinary disconnects between physicists and biologists. The siloing of academic research disciplines represents a significant barrier to progress. Disconnects in terminology, motivations and priorities, and structural barriers to collaborative work underscore the need for concerted efforts to bridge these divides. Attendees and speakers offered suggestions for resolving these divergences, establishing a shared language, moving the field forward, and fostering meaningful feedback between disciplines. Overall, participants stressed a need for balance, open communication, collaboration, unity, and clear dialogue on trade-offs between quantum and classical approaches. Keiko Torii, The University of Texas at Austin, said that the best collaborations happen when the project provides mutual advantages that can show off everyone’s talents, each team finds the work interesting, and partners develop a camaraderie to pursue new knowledge. To enable near- and long-term opportunities in this space, participants suggested that exploratory, high-risk funding could improve existing instrumentation to explore quantum enhancement collaboratively. They also emphasized the need for collaboration between quantum physicists and sensing/imaging scientists, which could be advanced through a dedicated quantum biology investigator program. People, even more than technology, will be crucial to the future of quantum biology. Participants explored training, education, and workforce needs to further develop this burgeoning field and cultivate the next generation of scientists. While many programs are still in their nascent stages, participants highlighted examples of approaches and programs being developed at various types of institutions to engage students and professional scientists in quantum biology research. Several participants stressed the need for an inclusive approach, spanning disciplines as well as communities to foster a diverse field fueled by the intellectual contributions of a wide range of people, including historically under-resourced schools and students. To increase awareness and excitement about quantum physics and related areas of biology, attendees suggested capitalizing on the “buzz” around quantum. Several participants emphasized the need to start early, introducing students to quantum concepts and their appealing “weirdness” in K–12 education. Engaging students early—before they become entrenched in traditional disciplinary siloes as typically happens in graduate school—could help to galvanize interest in the area and foster a generation of scientists with the interdisciplinary mindset and skills needed to advance this interdisciplinary field. While these efforts could be advanced at many levels and across multiple sectors, several participants suggested a national quantum biology center could be a valuable hub to coordinate and support quantum biology education and workforce development across academia, industry, and government.

59 BASIC BIOLOGICAL SCIENCES↗

ARCH: Large-scale knowledge graph via aggregated narrative codified health records analysis

Objective: Electronic health record (EHR) systems contain a wealth of clinical data stored as both codified data and free-text narrative notes (NLP). The complexity of EHR presents challenges in feature representation, information extraction, and uncertainty quantification. Here, to address these challenges, we proposed an efficient Aggregated naRrative Codified Health (ARCH) records analysis to generate a large-scale knowledge graph (KG) for a comprehensive set of EHR codified and narrative features. Methods: Using data from 12.5 million Veterans Affairs patients, ARCH first derives embedding vectors and generates similarities along with associated p-values to measure the strength of relatedness between clinical features with statistical certainty quantification. Next, ARCH performs a sparse embedding regression to remove indirect linkage between features to build a sparse KG. Finally, ARCH was validated on various clinical tasks, including detecting known relationships between entity pairs, predicting drug side effects, disease phenotyping, as well as sub-typing Alzheimer’s disease patients. Results: ARCH produces high-quality clinical embeddings and KG for over 60,000 codified and narrative EHR concepts. The KG and embeddings are visualized in the R-shiny powered web-API.3 ARCH achieved high accuracy in detecting EHR concept relationships, with AUCs of 0.926 (codified) and 0.861 (NLP) for similar EHR concepts, and 0.810 (codified) and 0.843 (NLP) for related pairs. It detected drug side effects with a 0.723 AUC, which improved to 0.826 after fine-tuning. Using both codified and NLP features, the detection power increased significantly. Compared to other methods, ARCH has superior accuracy and enhances weakly supervised phenotyping algorithms’ performance. Notably, it successfully categorized Alzheimer’s patients into two subgroups with varying mortality rates. Conclusion: The proposed ARCH algorithm generates large-scale high-quality semantic representations and knowledge graph for both codified and NLP EHR features, useful for a wide range of predictive modeling tasks.

Electronic health records↗

Tribal Revegetation Project Final Project Report: 92-Acre Area, Area 5 Radioactive Waste Management Complex, Nevada National Security Site, Nevada

Nuwu (Southern Paiute), Newe (Western Shoshone), and Nuumu (Owens Valley Paiute) are linguistically related, Numic-speaking peoples who are part of the broader Uto-Aztecan language group. Numic peoples view the land as a holistic, living, sentient being with feelings and purpose. The land is personified with human characteristics and it needs to be experienced to be understood through “learning by doing.” Numic peoples do not support ground disturbing activities within their ancestral lands, including activities tied to the storage of low-level radioactive waste or classified materials on the NNSS, which they view as culturally inappropriate. These deep-rooted ancestral connections are the impetus for reinforcing Numic responsibility for healing disturbed areas by integrating respect and patience with consistent Tribal interaction. Tribal Ecological Knowledge (TEK) is the science of describing Tribal approaches for understanding natural resources. Numic TEK is embedded in traditional teachings learned incrementally over time though experience and it evolves through lessons learned and responses to environmental changes over millennia. Therefore, TEK can broaden and enhance Western scientific knowledge associated with revegetation, especially in highly disturbed areas. The project blended TEK with Western scientific ecological methods to create a vegetative cover within test plots on the 92-Acre Area located at the Radioactive Waste Management Complex (RWMC) located in Area 5 on the Nevada National Security Site (NNSS). The vegetated test plots were systematically created for the Department of Energy (DOE) in tandem with the existing Federal Facilities Agreement and Consent Order (FFACO) with the Nevada Department of Environmental Protection (NDEP). Three previous contractor-lead attempts at revegetation, one targeting full cover revegetation and two targeting test plot revegetation, did not achieve the anticipated results at this location. When presented to the 16 American Indian Tribal nations and affiliated groups with cultural and historical ties to the NNSS, the group appointed a Tribal Revegetation Committee (TRC) that included six expert Tribal knowledge holders to collaborate with an ethnoecologist/cultural anthropologist and two biologists. Project design, planning, seed and outplant selection, spiritual land preparation, and methodology were guided by the TRC and an ethnoecologist/cultural anthropologist from Portland State University (PSU) and biologists from Desert Research Institute (DRI). Using TEK, the TRC recommended a specific seed mixture that contained nine native plant species and three species of outplants. The revegetation effort included preparing and planting thirty 10 m × 10 m (32.8 ft × 32.8 ft) seeded plots, twelve of which also included outplants; and eight 10 m × 100 m (32.8 ft × 328 ft) plots that only received outplants, all atop a waste cell cover. The TRC and the project team creatively adapted TEK with Western scientific methods so that the planned revegetation efforts could occur within the safety and security parameters of the RWMC. Test plots were subjected to one of five soil treatments with varying combinations of straw or mulch applications, soil amendment, and/or outplant planting and one of two watering treatments (watered or unwatered). Planting was divided into two events: one in the fall season and another during the subsequent spring season based on TEK and a corresponding recommendation from the TRC. Monitoring and spiritual management was conducted by the TRC to evaluate plant progress on a monthly basis (in conjunction with the biologist and anthropologist) during each respective growing season for a period of three years after planting. This approach allowed Tribal members the opportunity to conduct traditional blessings and other culturally appropriate activities to restore balance to the land in accordance with Tribal protocols. Following TEK-guided methods, successful plant establishment from seed stock and outplants was observed in many plots. Overall, plots planted in the spring, as recommended by the TRC, showed higher rates of outplant survival and native seedling emergence than those planted in the fall. This finding is significant because it is contrary to the original guidance and previous approaches provided for planting in this region. The TRC believes the frequent co-occurrence of native seedlings near surviving outplants indicates an important symbiotic relationship understood by Tribal communities and overlooked by others. Watered outplants displayed much higher survivability than unwatered plants, even after watering was reduced after the plants were established. Soil amendments and mulch created higher densities of native plants from seed. Many native seedlings showed significant delays in germination, which is considered a normal adaptation to desert climates. Some native plants did not germinate until the third growing year, whereas others germinated during the first growing year, which demonstrates the complexity of the desert environment. Evidence of native insects, reptiles, mammals, and birds, as well as native plants that were not part of the planted species, were noted and considered culturally significant. Despite the presence of non-native plants, native outplants continued to thrive and the incidence of native plant germination from seed increased over time. These successful revegetation results where previous efforts were unsuccessful reinforce the importance of integrating regionally appropriate, TEK-guided methodology with Western science to achieve positive results and the necessity of integrating Tribal involvement in all stages of the revegetation effort. Expanded approaches coupled with Tribal knowledge and tools from Western science addressed a complex problem tied to revegetating atop a low-level radioactive waste cell. The level of Tribal participation serves as a progressive model for building collaborative relationships and addressing ecological challenges on the NNSS.

54 ENVIRONMENTAL SCIENCES↗