Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “resource data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

A primer on artificial intelligence in plant digital phenomics: embarking on the data to insights journey

Artificial intelligence (AI) has emerged as a fundamental component of global agricultural research that is poised to impact on many aspects of plant science. In digital phenomics, AI is capable of learning intricate structure and patterns in large datasets. We provide a perspective and primer on AI applications to phenome research. We propose a novel human-centric explainable AI (X-AI) system architecture consisting of data architecture, technology infrastructure, and AI architecture design. We clarify the difference between post hoc models and 'interpretable by design' models. We include guidance for effectively using an interpretable by design model in phenomic analysis. We also provide directions to sources of tools and resources for making data analytics increasingly accessible. In conclusion, this primer is accompanied by an interactive online tutorial.

60 APPLIED LIFE SCIENCES↗

The integration of manual and automatic image analysis techniques with supporting ground data in a multistage sampling framework for timber resource inventories: Three examples

An approach to information acquisition is discussed in the context of meeting user-specified needs in a cost-effective, timely manner through the use of remote sensing data, ground data, and multistage sampling techniques. The roles of both LANDSAT imagery and Skylab photography are discussed as first stages of three separate multistage timber inventory systems and results are given for each system. Emphasis is placed on accuracy and meeting user needs.

Gialdini, M.↗

Accomplishments and Year-End Performance Report; Wind Energy Program: Fiscal Year 2021

The National Wind Technology Center (NWTC), located at the U.S. Department of Energy's (DOE's) National Renewable Energy Laboratory (NREL) Flatirons Campus, has been a driving force in advancing wind energy technology research worldwide since its designation as a DOE national research center in 1992. Enabled by the Flatirons Campus's world-class facilities, scientists, engineers, analysts, and researchers are pushing the frontiers of science to pursue wind energy innovation. In Fiscal Year (FY) 2021, NREL continued to provide the technical expertise, research capabilities, and industry understanding to support DOE's ambitious climate action and research goals by advancing technology, addressing market and deployment barriers, and driving down costs with more efficient, reliable, and predictable wind energy systems. One of several highlights, NREL received an R&D 100 Special Recognition Award for its Thermoplastic Resin System for Wind Turbine Blades. This breakthrough in the wind turbine manufacturing process will enable the production of recyclable blades that are stronger, longer, and less expensive, while increasing energy capture, decreasing energy and transportation costs, and increasing blade reliability. In a year when the entire U.S. economy struggled to address workforce gaps, an NREL study compared wind industry needs, training programs, and hiring practices with perspectives from students and recent college graduates. Researchers hope that, by pinpointing areas of disconnect, the expectations of employers who have difficulty filling entry-level jobs can better align with the preparation of the potential applicants who find it hard to break into the field. The lab also made numerous new data and modeling resources available in FY 2021. Recent NREL releases include a modeling tool for predicting the power performance and structural loads of wind turbines within a wind farm (FAST.Farm), a computational framework for modeling golden eagle behavior near wind farms, and 20 years of offshore wind data. Updates were also made to the widely used Wind Plant Integrated Systems Design and Engineering Model (WISDEM), which couples engineering and cost models to examine system-level trade-offs. Now, bolstered by a renewed national commitment to tackle climate change and revitalize the U.S. economy through increased investment in clean energy - particularly in offshore wind energy - NREL stands poised to lead the way to a sustainable future that powers the United States with significant levels of reliable, low-cost, accessible wind energy. This report provides an overview of the achievements NREL made on behalf of DOE's Wind Energy Technologies Office (WETO) and other partners during FY 2021 (between Oct. 1, 2020, and Sept. 30, 2021).

Flatirons Campus↗

Offsite Data Processing for the GlueX Experiment

The Thomas Jefferson National Accelerator Facility (JLab) 12GeV accelerator upgrade completed in 2015 is now producing data at volumes unprecedented for the lab. The resources required to process this data now exceed the capacity of the onsite farm necessitating the use of offsite computing resources for the first time in the history of JLab. GlueX is now utilizing NERSC and PSC for raw data production. Details of the workflow are presented.

Lawrence, David↗

A Quantitative Study of Deep Learning Training on Heterogeneous Supercomputers

Deep learning (DL) has become a key technique for solving complex problems in scientific research and discovery. DL training for science is substantially challenging because it has to deal with massive quantities of multi-dimensional data. High- performance computing (HPC) supercomputers are increasingly being employed for meeting the exponentially growing demand for DL. Multiple GPUs and high-speed interconnect network are needed for supporting DL on HPC systems. However, the excessive use of GPUs without considering effective benefits leads to inefficient resource utilization of these expensive setups. In this paper, we conduct a quantitative analysis to gauge the efficacy of DL workloads on the latest HPC system and identify viability of next-generation DL-optimized heterogeneous supercomputers for enabling researchers to develop more efficient resource management and distributed DL middleware. We evaluate well- known DL models with large-scale datasets using the popular TensorFlow framework, and provide a thorough evaluation in- cluding scalability, accuracy, variability, storage resource, GPU- GPU/GPU-CPU data transfer, and GPU utilization. Our analysis reveals that the latest heterogeneous supercomputing cluster shows varying performance trend as compared to the existing literature for single- and multi-node training. To the best of our knowledge, this is the first work to conduct such a quantitative and comprehensive study of DL training on a supercomputing system with multiple GPUs.

Han, Jingoo↗

Spatial Metadata for Global Change Investigations Using Remote Sensing

Satellite and aircraft-borne remote sensors have gathered petabytes of data over the past 30+ years. These images are an important resource for establishing cause and effect relationships between human-induced land cover changes and alterations in climate and other biophysical patterns at local to global scales. However, the spatial, temporal, and spectral characteristics of these datasets vary, thus complicating long-term studies involving several types of imagery. As the geographical and temporal coverage, the spectral and spatial resolution, and the number of individual sensors increase, the sheer volume and complexity of available data sets will complicate management and use of the rapidly growing archive of earth imagery. Mining this vast data resource for images that provide the necessary information for climate change studies becomes more difficult as more sensors are launched and more imagery is obtained.

Emerson, Charles W.↗

Medical Optimization Network for Space Telemedicine Resources

INTRODUCTION: Long-duration missions beyond low Earth orbit introduce new constraints to the space medical system. Beyond the traditional limitations in mass, power, and volume, consideration must be given to other factors such as the inability to evacuate to Earth, communication delays, and limitations in clinical skillsets. As NASA develops the medical system for an exploration mission, it must have an ability to evaluate the trade space of what resources will be most important. The Medical Optimization Network for Space Telemedicine Resources (MONSTR) was developed over the past year for this reason, and is now a system for managing data pertaining to medical resources and their relative importance when addressing medical conditions. METHODS: The MONSTR web application with a Microsoft SQL database backend was developed and made accessible to Tableau v9.3 for analysis and visualization. The database was initially populated with a list of medical conditions of concern for an exploration mission taken from the Integrated Medical Model (IMM), a probabilistic model designed to quantify in-flight medical risk. A team of physicians working within the Exploration Medical Capability Element of NASA's Human Research Program compiled a list diagnostic and treatment medical resources required to address best- and worst-case scenarios of each medical condition using a terrestrial standard of care and entered this data into the system. This list included both tangible resources (e.g. medical equipment, medications) and intangible resources (e.g. clinical skills required to perform a procedure). The physician team then assigned criticality values to each instance of a resource, representing the importance of that resource to diagnosing or treating its associated condition(s). Medical condition probabilities of occurrence during a Mars mission were pulled from the IMM and imported into the MONSTR database for use within a resource criticality-weighting algorithm. DISCUSSION: The MONSTR tool is a novel approach to assess the relative value of individual resources needed for the diagnosis and treatment of medical conditions. Future work will add resources for prevention and long term care of these conditions. Once data collection is complete, MONSTR will provide the operational and research communities at NASA with information to support informed decisions regarding areas of research investment, future crew training, and medical supplies manifested as part of any exploration medical system.

Rubin, D.↗

TopicOnTiles: Tile-Based Spatio-Temporal Event Analytics via Exclusive Topic Modeling on Social Media

Detecting anomalous events of a particular area in a timely manner is an important task. Geo-tagged social media data are useful resource for this task; however, the abundance of everyday language in them makes this task still challenging. To address such challenges, we present TopicOnTiles, a visual analytics system that can reveal information relevant to anomalous events in a multi-level tile-based map interface by using social media data. To this end, we adopt and improve a recently proposed topic modeling method that can extract spatio-temporally exclusive topics corresponding to a particular region and a time point. Furthermore, we utilize a tile-based map interface to efficiently handle large-scale data in parallel. Our user interface effectively highlights anomalous tiles using our novel glyph visualization that encodes the degree of anomaly computed by our exclusive topic modeling processes. To show the effectiveness of our system, we present several usage scenarios using real-world datasets as well as comprehensive user study results.

Choi, Minsuk↗

A description of the Global Resources Information Database

This paper describes the Global Resources Information Database (GRID), which is part of the Global Environmental Monitoring (GEM) Program. The following four objectives were established for GRID: (1) to collect and disseminate geographical information; (2) to construct within developing countries a geographical information system (GIS); (3) to demonstrate the ability of GIS to fuse global and national data sets for resource and environment management and planning at the national level; and (4) to train individuals from developing countries in remote sensing technology. The activities of GRID are coordinated at the GEM center at Nairobi (Kenya).

Vermillion, Charles H.↗

Supervised detection of anomalous light curves in massive astronomical catalogs

The development of synoptic sky surveys has led to a massive amount of data for which resources needed for analysis are beyond human capabilities. In order to process this information and to extract all possible knowledge, machine learning techniques become necessary. Here we present a new methodology to automatically discover unknown variable objects in large astronomical catalogs. With the aim of taking full advantage of all information we have about known objects, our method is based on a supervised algorithm. In particular, we train a random forest classifier using known variability classes of objects and obtain votes for each of the objects in the training set. We then model this voting distribution with a Bayesian network and obtain the joint voting distribution among the training objects. Consequently, an unknown object is considered as an outlier insofar it has a low joint probability. By leaving out one of the classes on the training set, we perform a validity test and show that when the random forest classifier attempts to classify unknown light curves (the class left out), it votes with an unusual distribution among the classes. This rare voting is detected by the Bayesian network and expressed as a low joint probability. Our method is suitable for exploring massive data sets given that the training process is performed offline. We tested our algorithm on 20 million light curves from the MACHO catalog and generated a list of anomalous candidates. After analysis, we divided the candidates into two main classes of outliers: artifacts and intrinsic outliers. Artifacts were principally due to air mass variation, seasonal variation, bad calibration, or instrumental errors and were consequently removed from our outlier list and added to the training set. After retraining, we selected about 4000 objects, which we passed to a post-analysis stage by performing a cross-match with all publicly available catalogs. Within these candidates we identified certain known but rare objects such as eclipsing Cepheids, blue variables, cataclysmic variables, and X-ray sources. For some outliers there was no additional information. Among them we identified three unknown variability types and a few individual outliers that will be followed up in order to perform a deeper analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Lanai high-density irradiance sensor network for characterizing solar resource variability of MW-scale PV system.

Sandia National Laboratories (Sandia) and SunPower Corporation (SunPower) have completed design and deployment of an autonomous irradiance monitoring system based on wireless mesh communications and a battery operated data acquisition system. The Lanai High-Density Irradiance Sensor Network is comprised of 24 LI-COR{reg_sign} irradiance sensors (silicon pyranometers) polled by 19 RF Radios. The system was implemented with commercially available hardware and custom developed LabVIEW applications. The network of solar irradiance sensors was installed in January 2010 around the periphery and within the 1.2 MW ac La Ola PV plant on the island of Lanai, Hawaii. Data acquired at 1 second intervals is transmitted over wireless links to be time-stamped and recorded on SunPower data servers at the site for later analysis. The intent is to study power and solar resource data sets to correlate the movement of cloud shadows across the PV array and its effect on power output of the PV plant. The irradiance data sets recorded will be used to study the shape, size and velocity of cloud shadows. This data, along with time-correlated PV array output data, will support the development and validation of a PV performance model that can predict the short-term output characteristics (ramp rates) of PV systems of different sizes and designs. This analysis could also be used by the La Ola system operator to predict power ramp events and support the function of the future battery system. This experience could be used to validate short-term output forecasting methodologies.

14 SOLAR ENERGY↗

The Resilient Energy Platform

The provision of reliable, secure, and affordable electricity is essential to power economic growth and development. The power system is at risk from an array of natural, human-caused, and technological threats, which can cause everything from power interruption to chronic undersupply of energy. It is critical for policymakers, planners, and system operators to safeguard their power systems from these threats by proactively planning for future needs and investing in resilient power systems. Developed through the USAID-NREL Partnership, the Resilient Energy Platform is a website that provides expertly curated resources, training materials, data, tools, and direct technical assistance in planning resilient, sustainable, and secure power systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Application of remote sensing to land and water resource planning: The Pocomoke River Basin, Maryland

Because of the size of the Pocomoke River Basin, the inaccessibility of certain areas, and study time constraints, several remote sensing techniques were used to collect base information on the river corridor, (a 23.2 km channel) and on a 1.2 km wooded floodplain. This information provided an adequate understanding of the environment and its resources, thus enabling effective management options to be designed. The remote sensing techniques used for assessment included manual analysis of high altitude color-infrared photography, computer-assisted analysis of LANDSAT-2 imagery, and the application of airborne oceanographic Lidar for topographic mapping. Results show that each techniques was valuable in providing the needed base data necessary for resource planning.

Wildesen, S. E.↗

Policy Considerations When Federating Facilities for Experimental and Observational Data Analysis

Today’s computational, experimental, and observational facilities afford us tremendous opportunities to couple theory and experiment at increasingly large scales. Empirical sensing capabilities are growing dramatically with beam line and detector improvements, and with advances in our ability to deploy large-scale data gathering observations of the natural world. The coupling of computational simulations and analysis to process the data from experimental and observational facilities is giving rise to cross-facility workflows. Such federations of facilities are in fact becoming an explicit requirement for large-scale scientific discovery. As we scale up these pipelines of scientific discovery, each participating facility needs to establish and align policies so that the federation can work seamlessly in an end-to-end manner. This chapter outlines specific policy considerations in enabling the federation of facilities for data analysis. Design choices and vital policy decisions cover the areas of data acquisition and storage, data transfer, computational resource allocation and co-scheduling, seamless federated user access, and cross-cutting governance. By highlighting the explicit and implicit interdependencies between facilities, we aim to provide facility designers and policymakers the information on policy issues to address early in a facility’s operations, thus enabling successful cross-facility federation and improved experimental and observational data analysis outcomes.

Shankar, Mallikarjun (Arjun)↗

Classifying Forest Type in the National Forest Inventory Context with Airborne Hyperspectral and Lidar Data

Forest structure and composition regulate a range of ecosystem services, including biodiversity, water and nutrient cycling, and wood volume for resource extraction. Forest type is an important metric measured in the US Forest Service Forest Inventory and Analysis (FIA) program, the national forest inventory of the USA. Forest type information can be used to quantify carbon and other forest resources within specific domains to support ecological analysis and forest management decisions, such as managing for disease and pests. In this study, we developed a methodology that uses a combination of airborne hyperspectral and lidar data to map FIA-defined forest type between sparsely sampled FIA plot data collected in interior Alaska. To determine the best classification algorithm and remote sensing data for this task, five classification algorithms were tested with six different combinations of raw hyperspectral data, hyperspectral vegetation indices, and lidar-derived canopy and topography metrics. Models were trained using forest type information from 632 FIA subplots collected in interior Alaska. Of the thirty model and input combinations tested, the random forest classification algorithm with hyperspectral vegetation indices and lidar-derived topography and canopy height metrics had the highest accuracy (78% overall accuracy). This study supports random forest as a powerful classifier for natural resource data. It also demonstrates the benefits from combining both structural (lidar) and spectral (imagery) data for forest type classification.

random forest↗

2025 Large Load Literature Review

This literature review catalogs more than 90 publications focused on large loads, and groups the documents and resources thematically into 12 categories, (listed below). The 2026 Large Load Literature Review and Data Sources summary reports are available here: https://emp.lbl.gov/publications/2026-large-load-literature-review -Load forecasting -Data sources -Reliability and resource adequacy -Large load interconnection -Demand flexibility -Generation -Co-location -Data center location/infrastructure -Large load tariffs -Policy options -Maps and tools -Design and operations

97 MATHEMATICS AND COMPUTING↗

Enabling discovery data science through cross-facility workflows

Experimental and observational instruments for scientific research (such as light sources, genome sequencers, accelerators, telescopes and electron microscopes) increasingly require High Performance Computing (HPC) scale capabilities for data analysis and workflow processing. Next-generation instruments are being deployed with higher resolutions and faster data capture rates, creating a big data crunch that cannot be handled by modest institutional computing resources. Often these big data analysis pipelines also require near real-time computing and have higher resilience requirements than the simulation and modeling workloads more traditionally seen at HPC centers. While some facilities have enabled workflows to run at a single HPC facility, there is a growing need to integrate capabilities across HPC facilities to enable cross-facility workflows, either to provide resilience to an experiment, increase analysis throughput capabilities, or to better match a workflow to a particular architecture. In this paper we describe the barriers to executing complex data analysis workflows across HPC facilities and propose an architectural design pattern for enabling scientific discovery using cross-facility workflows that includes orchestration services, application programming interfaces (APIs), data access and co-scheduling.

Antypas, Katerina B.↗