Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “open source analysis platform”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Bioinformatics Resource Manager: A systems biology web tool for microRNA and omics data integration

Background: The Bioinformatics Resource Manager (BRM) is a web-based tool developed to facilitate identifier conversion and data integration for Homo sapiens (human), Mus musculus (mouse), Rattus norvegicus (rat), Danio rerio (zebrafish), and Macaca mulatta (macaque), as well as perform orthologous conversions among the supported species. In addition to providing a robust means of identifier conversion, BRM also incorporates a suite of miRNA-target databases upon which to query target genes or to perform reverse target lookups using gene identifiers. Results: BRM has the capability to perform cross-species identifier lookups across common identifier types, directly integrate datasets across platform or species by performing identifier retrievals in the background, and retrieve miRNA targets from multiple databases simultaneously and integrate the resulting gene targets with experimental mRNA data. Here we use workflows provided in BRM to integrate RNAseq data across species to identify common biomarkers of exposure after treatment of human lung cells and zebrafish to benzo[a]pyrene (BAP). We further use the miRNA Target workflow to experimentally determine the role of miRNAs as regulators of BAP toxicity and identify the predicted functional consequences of miRNA-target regulation in our system. The output from BRM can easily and directly be uploaded to freely available visualization tools for further analysis. From these examples, we were able to identify an important role for several miRNAs as potential regulators of BAP toxicity in human lung cells associated with cell migration, cell communication, cell junction assembly and regulation of cell death. Conclusions: Overall, BRM provides bioinformatics tools to assist biologists having minimal programming skills with analysis and integration of high-content omics’ data from various transcriptomic and proteomic platforms. BRM workflows were developed in Java and other open-source technologies and are served publicly using Apache Tomcat at https://cbb.pnnl.gov/brm/.

bioinformatics, MicroRNA, systems biology, Genomic↗
NASA NTRS2010

The General Mission Analysis Tool (GMAT): Current Features And Adding Custom Functionality

The General Mission Analysis Tool (GMAT) is a software system for trajectory optimization, mission analysis, trajectory estimation, and prediction developed by NASA, the Air Force Research Lab, and private industry. GMAT's design and implementation are based on four basic principles: open source visibility for both the source code and design documentation; platform independence; modular design; and user extensibility. The system, released under the NASA Open Source Agreement, runs on Windows, Mac and Linux. User extensions, loaded at run time, have been built for optimization, trajectory visualization, force model extension, and estimation, by parties outside of GMAT's development group. The system has been used to optimize maneuvers for the Lunar Crater Observation and Sensing Satellite (LCROSS) and ARTEMIS missions and is being used for formation design and analysis for the Magnetospheric Multiscale Mission (MMS).

Conway, Darrel J.↗
DOE OSTI2024

Decomprolute is a benchmarking platform designed for multiomics-based tumor deconvolution

Tumor deconvolution is a reliable way to disentangle the diverse cell types that comprise solid tumors. To date, however, both the algorithms developed to deconvolve tumor samples, and the gold standard datasets used to assess the algorithms are geared toward the analysis of gene expression (e.g., RNA-seq) rather than protein levels in tumor cells. While gene expression is less expensive to measure, protein levels provide a more accurate view of immune markers. To facilitate the development as well as improve the reproducibility and reusability of multi-omic deconvolution algorithms, we introduce Decomprolute, a Common Workflow Language framework that leverages containerization to compare tumor deconvolution algorithms across multiomic data sets. Decomprolute incorporates the large-scale multiomic data sets produced by the Clinical Proteomic Tumor Analysis Consortium (CPTAC), which include matched mRNA expression and proteomic data from thousands of tumors across multiple cancer types to build a fully open-source, containerized proteogenomic tumor deconvolution benchmarking platform. The platform consists of modular architecture and it comes with well-defined input and output formats at each module. As a result, it is robust and extendable easily with additional algorithms or analyses. The platform is available for access and use at http://pnnl-compbio.github.io/decomprolute.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2016

Storage of Physical Sample Metadata in the Astrobiology Habitable Environments Database (AHED)

The National Aeronautics and Space Administration has begun an effort to store, curate, and publish information about physical samples collected and analyzed in conjunction with NASA-funded astrobiology research. Astrobiology is a multidisciplinary area of scientific research being conducted by collaborating teams of biologists, chemists, geologists, atmospheric scientists, oceanographers, astrophysicists, astronomers, and other specialists. Astrobiology studies the origin, evolution, and distribution of life in the Universe. NASA uses the results of astrobiology research to focus its future missions on targets of opportunity for the discovery of life off Earth. Astrobiology researchers conduct both field-based and laboratory-based research, during which physical samples are collected, processed, and catalogued. The cataloguing practices employed by different teams of astrobiologists vary widely, and there are no specific standards available to guide the collection and recording of astrobiology sample data. The disparity in data collection approaches and the lack of a centralized sample repository makes it difficult for astrobiology teams to share data and benefit from resultant synergies.To facilitate data sharing within the astrobiology community, NASA is developing a prototype database the Astrobiology Habitable Environments Database (AHED) and an associated set of data collection templates. The database will store information about samples, along with associated measurements and analyses, including information about biological cultures enriched or isolated from samples, and the results of analyses performed on the samples (e.g., via spectrography, microscopy, etc.). In addition, the system will store contextual information about field sites where samples were collected, the instruments or equipment used for analysis, and people and institutions involved in their collection. AHED is being implemented on top of Open Data Repository's Data Publisher [1], an open source software platform for the publication of scientific datasets. The data collection templates under development represent an initial attempt to propose a set of metadata for capture and storage within AHED. The design of these templates is being conducted by a consolidated group of astrobiologists from active research teams at NASA Ames Research Center, assisted by data science and software engineering specialists. These initial templates must be vetted with the broader astrobiology community through a defined process to ensure that they meet community needs. Each template captures a different type of data collection record. For each template, we are developing a list of fields to be captured, including a set of required entry fields, a set of recommended but optional fields, and a set of discretionary fields. A datatype selected from a variety of text and numeric types is specified for each field. Included is a 'choice' type that restricts user input to an enumerated list of values. Many of the fields and field values capture information of particular interest to the astrobiology community, and are intended to facilitate search and retrieval of relevant data across multiple datasets.

Keller, Rich↗
DOE OSTI2024

Hybrid power plant design for low-carbon hydrogen in the United States

In this study, we provide a nationwide techno-economic analysis of clean hydrogen production powered by a hybrid renewable energy plant for over 50,000 locations in the United States. We leverage the open-source Hybrid Optimization Performance Platform (HOPP) tool to simulate the hourly performance of an off-grid wind-solar plant integrated with a 1-GW polymer exchange membrane electrolyzer system. The levelized cost of hydrogen is calculated for varying technology costs, and tax credits to explore cost sensitivities independent of plant design, performance, and site selection. Our findings suggest that strategies for cost reduction include selecting sites with abundant wind resources, complementary wind and solar resources, and optimizing the sizing of wind and solar assets to maximize the hybrid plant capacity factor. These strategies are linked to increased hydrogen production and reduced electrolyzer stack replacements, thereby lowering the overall cost of hydrogen.

08 HYDROGEN↗
DOE OSTI2020

URBANopt: An Open-Source Software Development Kit for Community and Urban District Energy Modeling: Preprint

Urban building modeling tools are developing rapidly; these tools use emerging simulation workflows for specific urban environmental design tasks, such as assessing the impacts of energy efficiency technologies at a district scale. However, with the emergence of new environmental design tasks, addressing all possible use cases and tasks is challenging and cannot be covered by a single tool. Urban-scale analysis at this level of complexity often requires linking multiple emerging tools, rather than using a single tool, to adequately evaluate a variety of possible fields in urban environmental design. To achieve this, flexible platforms are needed to support multiple input formats (e.g., geometric and non-geometric building properties), enabling the mapping of such inputs to underlying simulation engines. This paper provides an overview of the open-source URBANopt Software Development Kit (SDK) for modeling high-performance buildings and energy systems at a district scale. URBANopt's flexible SDK is composed of several modules that can be customized to integrate with other tools and generate new workflows to perform urban environmental design tasks, such as capturing interactions between individual buildings, district energy systems, distributed energy resources, and the electric distribution grid. We describe the functionality of the core SDK modules in URBANopt (called Core Gem, GeoJSON Gem, and Scenario Gem) and discuss the flexibility of these modules as a means of integration with a variety of tools. We also document and demonstrate technical details of writing and combining new modules to create customized workflows. Finally, we present a case study that uses the URBANopt SDK to model a hypothetical mixed-use urban project and simulate various scenarios to meet district energy performance goals.

buildings↗
DOE OSTI2016

OPENSTUDIO® [SWR-07-40]

OpenStudio® is a cross-platform (Windows, Mac, and Linux) collection of software tools to support whole building energy modeling using EnergyPlus and advanced daylight analysis using Radiance. OpenStudio is an open source (LGPL) project to facilitate community development, extension, and private sector adoption. OpenStudio includes graphical interfaces along with a Software Development Kit (SDK). In addition to the graphical interface, OpenStudio allows building researchers and software developers to quickly get started through its multiple entry levels, including access through C++, Ruby, and C#. Users can leverage the Ruby interface to create OpenStudio Measures that can be easily shared and applied to OpenStudio Models. OPENSTUDIO® IS A REGISTERED TRADEMARK OF ALLIANCE FOR SUSTAINABLE ENERGY, LLC, THE MANAGER AND OPERATOR OF THE NATIONAL RENEWABLE ENERGY LABORATORY.

Ball, Brian↗
DOE OSTI2018

Quantifying the Mobility and Energy Benefits of Automated Mobility Districts Using Microscopic Traffic Simulation

Connected and automated vehicles (CAVs) are increasingly being discussed as the basis for shared mobility and on-demand services to replace privately owned vehicles. The rapid growth of transportation networking companies (TNCs) and their increasing investment in automated vehicle (AV) technologies attests to this. Combining the concepts of TNCs, with AV and on-demand transit services, the term 'automated mobility district' (AMD) describes a district-scale implementation of CAV technology to realize the full benefits of a shared, fully automated vehicle service within a confined region. This research effort provides a modeling architecture for AMDs along with a preliminary analysis to quantify the mobility and energy benefits of such districts. A customized open-source microscopic mobility simulation toolkit built on the simulation of urban mobility (SUMO) platform is implemented for AMD performance evaluation. Experimental scenarios are tested with different combinations of operational variables to provide insights on energy and mobility gains that can be realized in AMDs.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2018

Modeling and Simulation of Automated Mobility Districts

Connected and automated vehicles (CAVs) are increasingly being discussed as the basis for shared mobility and on-demand services to replace privately owned vehicles. The rapid growth of Transportation Networking Companies (TNCs) and their increasing investment in automated vehicle (AV) technologies attests to this. Combining the concepts of TNCs, with AVs and on-demand transit services, the term 'automated mobility district' (AMD) describes a district-scale implementation of CAV technology to realize the full benefits of a shared, fully automated vehicle service within a confined region. This research effort provides a modeling architecture for AMDs along with a preliminary analysis to quantify the mobility and energy benefits of such districts. A customized open-source microscopic mobility simulation toolkit built on the Simulation of Urban Mobility (SUMO) platform is implemented for AMD performance evaluation. Experimental scenarios are tested with different combinations of operational variables to provide insights on energy and mobility gains that can be realized in AMDs.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2018

Quantifying the Mobility and Energy Benefits of Automated Mobility Districts Using Microscopic Traffic Simulation

Connected and automated vehicles (CAVs) are increasingly being discussed as the basis for shared mobility and on-demand services to replace privately owned vehicles. The rapid growth of transportation networking companies (TNCs) and their increasing investment in automated vehicle (AV) technologies attests to this. Combining the concepts of TNCs, with AV and on-demand transit services, the term “automated mobility district” (AMD) describes a district-scale implementation of CAV technology to realize the full benefits of a shared, fully automated vehicle service within a confined region. This research effort provides a modeling architecture for AMDs along with a preliminary analysis to quantify the mobility and energy benefits of such districts. A customized open-source microscopic mobility simulation toolkit built on the simulation of urban mobility (SUMO) platform is implemented for AMD performance evaluation. Experimental scenarios are tested with different combinations of operational variables to provide insights on energy and mobility gains that can be realized in AMDs.

Zhu, Lei↗
DOE OSTI2024

Toward a high-fidelity tritium transport modeling for retention and permeation experiments

We report Tritium Migration Analysis Program version 8 (TMAP8), the latest version of TMAP, was developed within the framework of the Multiphysics Object-Oriented Simulation Environment (MOOSE). Created at Idaho National Laboratory (INL), MOOSE is an open-source, dimension-agnostic, fully coupled, and fully implicit multiphysics platform featuring massively parallel computation capabilities. Using TMAP8, tritium transport in a divertor monoblock was analyzed to elucidate the effects of pulsed operation (up to fifty 1,600 s plasma discharge and cool-down cycles) on the tritium in-vessel inventory source term and ex-vessel release term (i.e., tritium retention and permeation) for safety analysis. With its built-in Message Passing Interface capability, TMAP8 can, in under 2 h, simulate tritium transport in three different layered materials (i.e., tungsten, copper, and copper-chromium-zirconium alloy) in 2D geometry, using a single device/computer with 10 cores. The MOOSE-based TMAP8 code can leverage other MOOSE tools developed under the Nuclear Energy Advanced Modeling and Simulation program to perform tritium and thermal transport in complex geometries and multiphysics environments. And via its massively parallel computation, MOOSE will enable the fusion pilot plant designers to conduct high-fidelity multiphysics modeling for the design of the divertor and blanket systems as well as for the safety analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Energy-Aware Route Planning with RouteE Compass

This poster introduces RouteE Compass, a new tool that advances sustainable transportation by enabling energy-aware route planning across diverse vehicle types and large-scale road networks. By addressing practical trade-offs between energy consumption, travel time, and economic cost, RouteE Compass fills critical gaps in traditional routing methods, which often lack the flexibility to prioritize energy directly. The tool's scalability and high-performance computing capabilities allow for national-scale analyses, offering actionable insights for fleet operators, transit agencies, and researchers. As an open-source, extensible platform, RouteE Compass empowers ongoing research and innovation in energy-aware routing, supporting the broader goals of reducing emissions and enhancing transportation sustainability.

ADVANCED PROPULSION SYSTEMS,DIRECT ENERGY CONVERSI↗
DOE OSTI2023

Digital Twin for Optimizing Real-time Economy of the Integrated Energy Systems

Economic and safe operation of integrated energy systems (IES) requires real-time optimization (RTO) of the control and actions conducted on each system component. In this regard, digital twins (DTs), which consist of a physical system, a virtual system, and the data communication that occurs between the two, are essential for effective RTO. Through the data warehouse, the virtual system is constantly updated with real-time data from the physical system, and functions as the model in the optimization framework. The reduced-order model of the dynamic process model in the virtual system is used in the optimization framework. The optimization results are then returned, via the data warehouse, as control actions to the physical system. This work demonstrates the software capabilities of DT assets for an IES in the context of preparing a DT for an experimental system comprised of Idaho National Laboratory (INL)’s Thermal Energy Delivery System and battery system. For the virtual demonstration, the DTs encompass (1) a physical system, including the Modelica models of the Thermal Energy Delivery System and the battery system; (2) virtual optimization via the Optimization of Real-Time Capacity Allocation (ORCA) platform; and (3) the open-source data warehouse software DeepLynx. This work assesses the performance of ORCA, which utilizes a reduced-order model built using the Risk Analysis Virtual Environment (RAVEN) and trained on the Modelica models and real-time data pipeline through the graph database hosted in DeepLynx. The proposed optimization workflow will be an RTO model based on DTs and the data they generate.

25 ENERGY STORAGE↗
DOE OSTI2015

Final Report for Project: Impacts of stratification and non-equilibrium winds and waves on hub-height winds

This project used a combination of turbulence-resolving large-eddy simulations, single-column modeling (where turbulence is parameterized), and currently available observations to improve, assess, and develop a parameterization of the impact of non-equilibrium wave states and stratification on the buoy-observed winds to establish reliable wind data at the turbine hub-height level. Analysis of turbulence-resolving simulations and observations illuminates the non-linear coupling between the atmosphere and the undulating sea surface. This analysis guides modification of existing boundary layer parameterizations to include wave influences for upward extrapolation of surface-based observations through the turbine layer. Our surface roughness modifications account for the interaction between stratification and the effects of swell’s amplitude and wavelength as well as swell’s relative motion with respect to the mean wind direction. The single-column version of the open source Weather and Research Forecasting (WRF) model (Skamarock et al., 2008) serves as our platform to test our proposed planetary boundary layer parameterization modifications that account for wave effects on marine atmospheric boundary layer flows. WRF has been widely adopted for wind resource analysis and forecasting. The single column version is particularly suitable to development, analysis, and testing of new boundary layer parameterizations. We utilize WRF’s single-column version to verify and validate our proposed modifications to the Mellor-Yamada-Nakanishi-Niino (MYNN) boundary layer parameterization (Nakanishi and Niino, 2004). We explore the implications of our modifications for two-way coupling between WRF and wave models (e.g.,Wavewatch III). The newly implemented parameterization accounting for marine atmospheric boundary layer-wave coupling is then tested in three-dimensional WRF simulations at grid sizes near 1 km. These simulations identify the behavior of simulated winds at the wind plant scale. Overall project conclusions include; In the presence of fast-moving swell (significant wave height Hs = 6.4 m, and phase speed cp = 18 ms -1 ), the atmospheric boundary layer grows more rapidly when waves propagate opposite to the winds compared to when winds and waves are aligned. Pressure drag increases by nearly a factor of 2 relative to the turbulent stress for the extreme case where waves propagate at 180° compared to the pressure gradient forcing. Net wind speed reduces by nearly 15% at hub-height for the 180°-case compared to the 0°-case, and turbulence intensities increase by nearly a factor of 2. These impacts diminish with decreasing wave age; Stratification increases hub height wind speeds and increases the vertical shear of the mean wind across the rotor plane. Fortuitously, this stability-induced enhanced shear does not influence turbulence intensity at hub height, but does increase (decrease) turbulence intensity below (above) hub height. Increased stability also increases the wave-induced pressure stress by ~ 10%; Off the East Coast of the United States during Coupled Boundary Layers Air-Sea Transfer - Low Wind (CBLAST-Low), cases with short fetch include thin stable boundary layers with depths of only a few tens of meters. In the coastal zone, the relationship between the mean wind and the surface fiction velocity (u*(V )) is significantly related to wind direction for weak winds but is not systematically related to the air sea difference of virtual potential temperature, δθv; since waves generally propagate from the south at the Air-Sea Interaction Tower (ASIT) tower, these results suggest that under weak wind conditions waves likely influence surface stress more than stratification does; and Winds and waves are frequently misaligned in the coastal zone. Stability conditions persist for long duration. Over a four year period, the Forschungsplattformen in Nord- und Ostsee Nr. 1 (FINO1) tower (a site with long fetch) primarily experienced weakly-unstable conditions, while stability at the ASIT tower (with a larger influence of offshore winds) experiences a mix of both unstable and stable conditions, where the summer months are predominantly stable. Wind-wave misalignment likely explains the large scatter in observed non-dimensional surface roughness under swell-dominated conditions. Andreas et al.’s (2012) relationship between u* and the 10-m wind speed under predicts the increased u* produced by wave-induced pressure drag produced by misaligned winds and waves. Incorporating wave-state (speed and direction) influences in parameterizations improves predictive skill. In a broad sense, these results suggest that one needs information on winds, temperature, and wave state to upscale buoy measurements to hub-height and across the rotor plane. Our parameterization of wave-state influences on surface drag has been submitted for inclusion in the next publicly available release. In combination, our project elucidates the impacts of two important physical processes (non-equilibrium wind/waves and stratification) on the atmosphere within which offshore turbines operate. This knowledge should help guide and inform manufacturers making critical decisions surrounding design criteria of future turbines to be deployed in the coastal zone. Reductions in annually averaged hub height wind speed error using our new wave-state-aware surface layer parameterization are relatively modest. However since wind turbine power production depends on the wind speed cubed, the error in estimated power production is close to 5%; which is significant and can substantially impact wind resource assessment and decision making with regards to the viability of particular location for a wind plant location. For a single 30-hour forecast, significant reductions in wind speed prediction errors can yield substantially improved wind power forecast skill, thereby mitigating costs and/or increasing revenue through improved; forecasting for maintenance operations and planning; day-ahead forecasting for power trading and resource allocation; and short-term forecasting for dispatch and grid balancing.

17 WIND ENERGY↗
NASA NTRSDate not supplied

Biomass Harmonization and SAR Analysis with the Multi-mission Algorithm and Analysis Platform (MAAP)

The Multi‐mission Algorithm and Analysis Platform (MAAP) is a collaborative effort between NASA and the European Space Agency (ESA) to support above ground biomass (AGB) research in an open science framework. MAAP brings together relevant data, algorithms, and computing capabilities in a common cloud environment to address the challenges of sharing and processing data from field, airborne and satellite measurements. MAAP was publicly released in October 2021, providing computing capabilities co-located with the data, a collaborative coding and analysis environment, and a set of interoperable tools and algorithms developed to support the estimation and visualization of data. MAAP has allowed scientists from both North America and Europe to collaborate on the generation and analysis/visualization of data derived from multiple, discipline-adjacent missions in an open, collaborative environment that has reached beyond traditional scientific investigation. MAAP has been used to support multiple scientific activities. To date, existing LiDAR data from multiple platforms has been calibrated with field measurements and combined for more comprehensive and accurate estimates of above ground biomass AGB; these LiDAR platforms include airborne (e.g. LVIS), the International Space Station (NASA’s Global Ecosystem Dynamics Investigation (GEDI), and satellites (e.g. ICESat-2). The current challenge is to effectively and seamlessly combine the aforementioned LiDAR-based data with new data sources such as P-band RADAR from ESA’s upcoming BIOMASS mission, existing ESA Sentinel-1 C-band SAR, and the 30 PB/yr of high cadence global coverage L-band SAR data from the upcoming NASA-ISRO SAR (NISAR) mission. Recent analysis using MAAP merged ICESat-2 and optical data (Harmonized Landsat Sentinel) produced the most comprehensively precise estimate of boreal-wide AGB to date. Another effort using MAAP is the production and open distribution of global comparisons of AGB map estimates, including from ICESat-2 and GEDI, to bolster stakeholder uptake for policy applications. These map estimates will feed into the Intergovernmental Panel on Climate Change (IPCC) database, likely aiding the next Global Carbon Stocktake of the UNFCCC. Furthermore, the biomass retrieval intercomparison exercise BRIX-2 could benefit from the MAAP providing standardized test cases (based on airborne campaign and spaceborne data) allowing the community to develop and apply retrieval algorithms based on these test cases, while forthcoming SAR data training curricula could also use the MAAP as a teaching and learning platform. The MAAP is meeting the challenges inherent in international, open science collaboration and large scale computing with a platform that is entirely open source and cloud native, using open standards for data access, manipulation, protocols, and formats. The MAAP data system consists of a dedicated data store whose data is indexed in an online catalog conforming to established metadata, application programmatic interfaces (APIs), and service interface standards, using an implementation of the open sourced NASA Common Metadata Repository. Federation of user identities allows users from either NASA or ESA to access and consume services from the other using a unified metadata catalog for the data utilized across the ESA and NASA MAAP platforms. Similarly, we are exploring how to increase interoperability to achieve a common approach to packaging, orchestrating and executing algorithms, with interoperable access to data for subsetting, fast browse, and cloud-optimized access, all using interoperable standards such as those from the Open Geospatial Consortium (OGC). Designed for interoperability, ESA and NASA utilize a common architecture for the software platform. It provides a cloud-based algorithm development environment (ADE) that enables scientists to develop algorithms collaboratively with access to the MAAP data catalog as well as other data archives. MAAP provides an Eclipse Che-based ADE supporting both Python and R languages, popular in this biomass community. Algorithms developed and containerized within the ADE can be deployed to run to thousands of computational nodes in the MAAP’s data processing system (DPS), dramatically speeding up processing and giving scientists a rapid, iterative turnaround of results. NASA’s implementation of the DPS is based on the Hybrid Science Data System (HySDS) framework, used by NASA flight projects to produce Earth science standard products.

cloud computing↗
DOE OSTI2022

DERMS Online: A New Voltage Sensitivity-Enabled Feedback Optimization Framework: Preprint

This paper proposes a distributed energy resource management system (DERMS) solution by developing a new voltage sensitivity enabled feedback optimization framework. The key idea is to adopt a measurement feedback scheme to reformulate the original nonlinear optimization into a linear programming (LP) problem via perturb and observe-based voltage sensitivity analysis. The proposed solution eliminates the dependence on load knowledge and can be implemented online thanks to an efficient open-source solver for LP problems. The proposed DERMS online platform is generalizable to deal with various types of distributed energy resources (DERs), including distributed photovoltaics (PVs), energy storage, electric vehicles, demand response, etc. Comparison results with other control methods on a realistic distribution feeder in Southern California highlight the feasibility as well as benefits for the proposed framework.

distributed energy resources management↗
DOE OSTI2023

Conquering Data Chaos: Research Data Management with Kubernetes

Managing massive volumes of data and effectively making it accessible to researchers poses significant challenges and is a barrier to scientific discovery. In many cases, critical data is locked up in unwieldy file formats or one-off databases and is too large to effectively process on a single machine. This talk explores the role of Kubernetes, an open-source container orchestration platform, in addressing research data management challenges. I will discuss how we are using a set of publicly available open-source and home-grown tools in the National Renewable Energy Lab (NREL) Data, Analysis, and Visualization (DAV) group to help researchers overcome data-related bottlenecks. The talk will begin by providing an overview of the data challenges faced in research data management, including data storage, processing, and analysis. I will highlight Kubernetes' ability to handle large-scale data by leveraging containerization and distributed computing, including distributed storage. Kubernetes allows researchers to encapsulate data processing infrastructure and workflows into portable containers, enabling reproducibility and ease of deployment. Kubernetes can then schedule and manage the resource allocation of these containers to enable efficient utilization of limited computing resources, leading to more efficient data processing and analysis. I will discuss some limitations of traditional, siloed approaches to dealing with data and emphasize the need for solutions which foster collaboration. I will highlight how we are using Kubernetes at NREL to facilitate data sharing and cooperation among research teams. Kubernetes' flexible architecture enables the deployment of shared computing environments, such as Apache Superset, where researchers can seamlessly access and analyze shared datasets. Providing the ability to have one research team easily consume data generated by another, utilizing Kubernetes' as a central data platform, is one of the major wins we've encountered by adopting the platform. Finally, I will showcase real-world use cases from NREL where we have used Kubernetes to solve some persistent data challenges involving large volumes of sensor and monitoring data. I will discuss the challenges we encountered when creating our cluster and making it available as a production-ready resource. I will also discuss the specific suite of tools, including Postgres and Apache Druid for columnar and timeseries data, and Redpanda Kafka for streaming data we have deployed in our infrastructure, and the process that went into the selection of these tools.

collaborative environment↗
NASA NTRS2018

PYSAT: Python Satellite Data Analysis Toolkit

A common problem in space science data analysis is combining complementary data sources that are provided and analyzed in different formats and programming languages. The Python Satellite Data Analysis Toolkit (pysat) addresses this issue by providing an open source toolkit that implements the general process of space science data analysis, from beginning to end, in an instrumentindependent manner. This toolkit uses an Instrument object that enables systematic analysis of science data from a variety of platforms within a single interface. Basic functions such as downloading, loading, and cleaning are included for all supported instruments. Common analysis routines are also included, which are instrument and data source independent. A nanokernel is used to provide instrument independence, it is attached to the Instrument object and mediates the systematic and arbitrary modification of loaded data. Pysat uses the nanokernel to improve the rigor of time series analysis, support onthefly orbit determination, and cleanly span file breaks. Pysat's functions and higherlevel scientific analysis features are validated through the use of unit testing. Further adoption by the community provides a set of scientific results produced by a common core, constituting a distributed heritage that supports the validity of the underlying processing and scientific output. These features are used to demonstrate consistency between derived electron density profiles and measured ion drifts, particularly downward ion drifts in the afternoon hours during extreme solar minimum. Pysat builds upon open source Python software that is freely available and encourages communitydriven development.

Stoneback, R.A.↗