Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “software ecosystem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Detector Interface for Streaming, Control, and Open-source integration (DISCO) v1.0.0

This suite consists of a multi-package ecosystem featuring detector emulators, EPICS areaDetector drivers, and remote server frameworks designed for the Advanced Light Source (ALS). Engineered for high-bandwidth devices—including VFCCD, Timepix3, Timepix4, and related pixel detectors—the software simulates hardware, wraps vendor SDKs into remote-callable servers, and integrates with open-source control systems. Key Capabilities: Distributed SDK Architecture: Server packages wrap hardware-specific SDKs, allowing areaDetector drivers to execute remote framework calls. This isolates proprietary libraries from the EPICS IOC, enhancing stability and enabling distributed computing across beamline networks. Device Support: Custom drivers for VFCCD, the Timepix family, and similar sensors optimize the data path from hardware control to high-speed transport. Full-Stack Emulation: Sophisticated emulator packages allow end-to-end pipeline testing and software development without requiring physical hardware or beam time. Integrated Workflows: Supports high-bandwidth streaming for real-time analysis and robust, metadata-rich file-based workflows (e.g., HDF5/NeXus). By standardizing interfaces across heterogeneous hardware, this suite reduces technical debt. It provides the ALS with a scalable, open-source solution to manage massive data rates within a unified control environment.

Mahl, Johannes [Lawrence Berkeley National Laborat↗

Accelerating Control Systems with GitOps: A Path to Automation and Reliability

GitOps is a foundational approach for modernizing infrastructure by leveraging Git as the single source of truth for declarative configurations. The poster explores how GitOps transforms traditional control system infrastructure, services and applications by enabling fully automated, auditable, and version-controlled infrastructure management. Cloud-native and containerized environments are shifting the ecosystem not only in the IT industry but also within the computational science field, as is the case of CERN and Diamond Light Source among other Accelerator/Science facilities which are slowly shifting towards modern software and infrastructure paradigms. The ACORN project, which aims to modernize Fermilab’s control system infrastructure and software is implementing proven best-practices and cutting-edge technology standards including GitOps, containerization, infrastructure as code and modern data pipelines for control system data acquisition and the inclusion of AI/ML in our accelerator complex.

Gonzalez, M. [Fermilab]↗

AmeriFlux FLUXNET-1F US-xNW NEON Niwot Ridge Mountain Research Station (NIWO)

This is the AmeriFlux Management Project (AMP) created FLUXNET-1F version of the carbon flux data for the site US-xNW NEON Niwot Ridge Mountain Research Station (NIWO). This is the FLUXNET version of the carbon flux data for the site US-xNW NEON Niwot Ridge Mountain Research Station (NIWO) produced by applying the standard ONEFlux (1F) software. Site Description - The Niwot Ridge sits approximately 27 km west of Boulder, Colorado, and 6 km east of the Continental Divide. Topography, climate, and biota of the site are representative of Rocky Mountain alpine ecosystems, including extensive alpine tundra (mostly herbs, some shrubs and scree) and subalpine coniferous forests (Abies lasciocarpa and Picea engelmanii at higher elevations), talus slopes, wetlands and a variety of glacial landforms. Characterized by cold and relatively long winters, Niwot Ridge has an average annual temperature of 1.5°C and average annual precipitation of 800 mm. Most precipitation falls as snow and summer precipitation falls primarily during afternoon thunderstorms. Located on the eastern side of the Continental Divide at 3,000-3,500 m elevation, the site best captures chemical inputs produced along the Front Range and is well situated to observe other east/west flows across the Southern Rockies in conjunction with other NEON sites.

Network), NEON (National Ecological Observatory [N↗

DeepSAT: A Deep Learning Approach to Tree-Cover Delineation in 1-m NAIP Imagery for the Continental United States

High resolution tree cover classification maps are needed to increase the accuracy of current land ecosystem and climate model outputs. Limited studies are in place that demonstrates the state-of-the-art in deriving very high resolution (VHR) tree cover products. In addition, most methods heavily rely on commercial softwares that are difficult to scale given the region of study (e.g. continents to globe). Complexities in present approaches relate to (a) scalability of the algorithm, (b) large image data processing (compute and memory intensive), (c) computational cost, (d) massively parallel architecture, and (e) machine learning automation. In addition, VHR satellite datasets are of the order of terabytes and features extracted from these datasets are of the order of petabytes. In our present study, we have acquired the National Agriculture Imagery Program (NAIP) dataset for the Continental United States at a spatial resolution of 1-m. This data comes as image tiles (a total of quarter million image scenes with ~60 million pixels) and has a total size of ~65 terabytes for a single acquisition. Features extracted from the entire dataset would amount to ~8-10 petabytes. In our proposed approach, we have implemented a novel semi-automated machine learning algorithm rooted on the principles of "deep learning" to delineate the percentage of tree cover. Using the NASA Earth Exchange (NEX) initiative, we have developed an end-to-end architecture by integrating a segmentation module based on Statistical Region Merging, a classification algorithm using Deep Belief Network and a structured prediction algorithm using Conditional Random Fields to integrate the results from the segmentation and classification modules to create per-pixel class labels. The training process is scaled up using the power of GPUs and the prediction is scaled to quarter million NAIP tiles spanning the whole of Continental United States using the NEX HPC supercomputing cluster. An initial pilot over the state of California spanning a total of 11,095 NAIP tiles covering a total geographical area of 163,696 sq. miles has produced true positive rates of around 88 percent for fragmented forests and 74 percent for urban tree cover areas, with false positive rates lower than 2 percent for both landscapes.

Imagery↗

InSAR Scientific Computing Environment

This computing environment is the next generation of geodetic image processing technology for repeat-pass Interferometric Synthetic Aperture (InSAR) sensors, identified by the community as a needed capability to provide flexibility and extensibility in reducing measurements from radar satellites and aircraft to new geophysical products. This software allows users of interferometric radar data the flexibility to process from Level 0 to Level 4 products using a variety of algorithms and for a range of available sensors. There are many radar satellites in orbit today delivering to the science community data of unprecedented quantity and quality, making possible large-scale studies in climate research, natural hazards, and the Earth's ecosystem. The proposed DESDynI mission, now under consideration by NASA for launch later in this decade, would provide time series and multiimage measurements that permit 4D models of Earth surface processes so that, for example, climate-induced changes over time would become apparent and quantifiable. This advanced data processing technology, applied to a global data set such as from the proposed DESDynI mission, enables a new class of analyses at time and spatial scales unavailable using current approaches. This software implements an accurate, extensible, and modular processing system designed to realize the full potential of InSAR data from future missions such as the proposed DESDynI, existing radar satellite data, as well as data from the NASA UAVSAR (Uninhabited Aerial Vehicle Synthetic Aperture Radar), and other airborne platforms. The processing approach has been re-thought in order to enable multi-scene analysis by adding new algorithms and data interfaces, to permit user-reconfigurable operation and extensibility, and to capitalize on codes already developed by NASA and the science community. The framework incorporates modern programming methods based on recent research, including object-oriented scripts controlling legacy and new codes, abstraction and generalization of the data model for efficient manipulation of objects among modules, and well-designed module interfaces suitable for command- line execution or GUI-programming. The framework is designed to allow users contributions to promote maximum utility and sophistication of the code, creating an open-source community that could extend the framework into the indefinite future.

Rosen, Paul A.↗

pyCRTM: A Python Interface for the Community Radiative Transfer Model

The Community Radiative Transfer Model (CRTM) is a powerful and versatile scalar radiative transfer model for satellite data assimilation and remote sensing applications. It is implemented as an object-oriented Fortran library, enabling flexible code development and optimal runtime performance on clusters. The downsides of the Fortran interface are a steep learning curve for students and the reduced productivity of users that is typical for static compiled languages, in contrast to dynamic interpreted languages like Python. pyCRTM is a new software framework that directly interfaces the CRTM Fortran data structures and procedures in Python, leveraging both the simplicity and ease of use of Python syntax as well as the flexibility arising from the vast contemporary Python ecosystem. The goal of pyCRTM is to lower the barrier of entry for university students to learn and use the CRTM and to boost the productivity of researchers seeking to create new methods in radiative transfer and data assimilation, or seeking to apply the CRTM to study atmospheric phenomena without having to go through the pre-existing complexity of the CRTM Fortran interface.

Python↗

SPRUCE Root Production Assessed with Manual Minirhizotrons Resolved to Plant Functional Type, 2015-2021

This dataset contains raw root length and diameter for individual roots and estimated root population production measurements from the Spruce and Peatland Responses Under Changing Environments (SPRUCE) experimental site within the Marcell Experimental Forest in northern Minnesota, USA. Measurements started at the beginning of whole ecosystem warming manipulations in 2015 through 2021 (2015-05-26 to 2021-09-01). Root morphology and estimated production were quantified throughout the peat profile with manual minirhizotrons deployed within SPRUCE plots. Images were processed using commercial software to quantify the length and diameter of individual roots. Roots were visually assigned to a plant functional type (PFT) of either (ericaceous) shrub, herb (sedges and Maianthemum trifolium), or tree (Larix laricina, Picea mariana) based on expert opinion. The biomass of individual roots was estimated using PFT-specific allometric equations (Iversen et al., 2018). Production per day was estimated as the length of new roots produced between imaging sessions, divided by the number of days between imaging sessions. These values were placed on a m2 aboveground area basis and scaled to a standard depth of 1m (roots are not evenly distributed with depth, do not interpret value as being on a m3 basis). Maximum and average (weighted by production length) depth of each PFT were also estimated within each minirhizotron tube. Annual production was interpolated as the average of four methods to scale these data (see Weber et al, 2026). Standing crop of roots was estimated for each tube as the maximum visible amount (both length and mass) of roots of that PFT for that year. These data expand the ability of researchers to accurately estimate the belowground dynamics of peatland vegetation, as well as the role that fine roots may play in impacting the fluxes of carbon within peatlands. This dataset contains three data files in comma-separate values (*.csv) format. This dataset contains one data file in comma-separate values (.csv) format. Additional metadata are provided: three data dictionaries and a file-level metadata file in comma-separate values (.csv) format and a user guide in PDF (*.pdf) format.

54 ENVIRONMENTAL SCIENCES↗

A Concept for Civil Space Traffic Management

As technology has improved, operators have sought to use cubesats, as well as smallsats more generally, to perform increasingly more ambitious and sophisticated functions. Despite this, practical concerns associated with cubesat infant mortality, conjunctions, limited maneuverability, and debris generation have been relatively muted because most cubesats have been launched to lower orbits that limit both their orbital lifetime and consequences should a collision occur. NASA ARC has developed a concept for a highly-automated and distributed space traffic management (STM) architecture, drawing on similar work done to provide traffic management for small unmanned aerial systems (UAS) operating at low altitudes. The system proposes a strategy to accommodate growing space traffic volume safely, as well as pave the way for a transition of civil STM authority to a civilian governmental entity. The architecture envisions an open-access software platform architecture of data and service suppliers, consumers, and regulators, connected via a set of application programming interfaces (APIs). The platform would build on, rather than replicate existing integration and coordination efforts within the space situational awareness ecosystem, using existing standards for data message formats from organizations like the Consultative Committee for Space Data Systems and wrapping, rather than replacing existing integrations. We will present an initial STM architecture in this presentation, with a few examples showing how stakeholders can interact structurally, but flexibly, within this architecture.

Space Situational Awareness↗

Plant Characteristics, Porewater, Gas Flux, and Soil Biogeochemistry at Council Road Site Mile Marker 71, Seward Peninsula, Alaska, 2023

Data collected at Council, AK (64°51’35.0”N 163°41’59.1”W) during a summer campaign in 2023. Water data consists of soil porewater collected by centrifuging soil cores and also by field collection with porewater samplers (rhizons). Gas data consists of CO2, CH4 and N2O surface soil fluxes measured with a portable FTIR analyzer. Plant and root data consists of biomass, root length, diameter and mass. Soil data consists of total C and N. Air, water and soil samples span two main locations: a thermokarst wetland and an upland tussock. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).This dataset was generated to broadly address the following research question: how will climate change (i.e., thawing permafrost, landscape change) alter the ecosystem flux (sink versus source) of important greenhouse gases such as CO2, CH4 and N2O?Description of the contents of this data package: This dataset contains 5 different individual .csv files containing plant, soil, water and gas data. No software is needed to utilize them. PFTCover: Plant functional type ground cover in 1x1 meter plots. SoilCores: Solidphase and porewater phase soil biogeochemical variablesPlantData: Above and belowground plant traits. GasFlux: Surface plant-soil gas measurementsFieldPorewater: Field collected porewater biogeochemical variables

54 ENVIRONMENTAL SCIENCES↗

Tabletop Testing for EV Charging Ecosystem PKI (Project T34PKI Final Report)

To test the communications and cybersecurity functionality, Electric Vehicle and charging station vendors have had to ship their products to in-person testing events. This is cumbersome, expensive, inefficient, and an impediment to rapid time-to-deployment. In this project Sandia used COTS hardware and Open-Source Software to develop and demonstrate a more agile, productive approach: testing low-voltage controllers independently from high-voltage power delivery sub-systems. This approach allows communications controllers to be transported easily (e.g. shipped at low cost, checked as airline baggage); set up on a table-top (“bench testing”); and use ordinary 120 VAC outlets to conduct agile testing. Table-top platforms become end nodes that can connect to laboratory and cloud-based servers to test communications and cybersecurity, specifically Public Key Infrastructure (PKI) functionality and interoperability, separately from EV battery charging (power/energy transfer) functionality.

33 ADVANCED PROPULSION SYSTEMS↗

Processed Soil Respiration at the TRACE experimental Warming project, Aug 2015 - Sep 2017, Sabana, Luquillo, Puerto Rico

This data package contains processed measurements of soil carbon dioxide (CO₂) efflux collected using LI-COR LI-8100 soil respiration chambers at the Tropical Responses to Altered Climate Experiment (TRACE) located at the Sabana Field Research Station near Luquillo, Puerto Rico. The TRACE site is a mature, closed-canopy tropical wet forest within the Luquillo Experimental Forest. These data quantify soil surface CO₂ fluxes from both ambient (control) and experimentally warmed plots to evaluate how long-term soil warming affects belowground carbon cycling in tropical ecosystems. The data files include time-series tables of CO₂ flux (µmol CO₂ m⁻² s⁻¹), soil temperature (°C), and ancillary environmental variables, stored in comma-separated values (CSV) format and viewable with any text editor, spreadsheet, or statistical software (e.g., R, Python, Excel). Associated metadata describe plot identifiers, measurement intervals, and processing steps. These data were generated to address the research question: How does sustained soil warming influence soil respiration and carbon flux dynamics in tropical wet forests?

54 ENVIRONMENTAL SCIENCES↗

Cybersecurity at the Grid Edge: Protecting LA's Energy Systems in a Connected World

Join SoCalGas and the National Laboratory of the Rockies (NLR) for an insightful webinar on securing operational technology and energy systems. Los Angeles has the second-largest metro by population in the nation, making it vital to protect the energy infrastructure that powers day-to-day life. However, cybersecurity for energy systems is an immense challenge due to an increasing number of interconnected devices and stakeholders. While there was traditionally a limited need to secure energy infrastructure, the grid is only becoming smarter and more software-defined. Amid aging infrastructure and evolving cyber threats, the need to ensure the security of energy is at an all-time high. Together, SoCalGas and NLR are assessing the current state-of-the-art of the energy ecosystem to understand gaps in current best practices and technologies relevant to powering the city of Los Angeles.

97 MATHEMATICS AND COMPUTING↗

DRF: A Software Architecture for a Data Marketplace to Support Advanced Air Mobility

Advanced Air Mobility is a new aviation vision, where unmanned aerial systems will trans- port passengers and cargo across urban and rural areas. Critical to the realization of this vision is the development of a digital marketplace, which allows service providers and consumers operating in the airspace ecosystem to securely exchange data and reasoning insights. In this paper, we present the architecture of a decentralized data marketplace that connects data and reasoning service providers to vehicles and other service consumers along the cloud-to-edge continuum. We also present two example use cases to demonstrate the value of our approach.

Autonomy↗

Characterization of Soil and Rock Magnetic Properties along Multiple Hillslope Transects at Teller Road Site, Seward Peninsula, Alaska, 2018 and 2023

The magnetometer data was collected in multiple directions across the watershed hillslope at the NGEE Arctic Teller Road site at mile marker 27 (TL_MM27) on the Seward Peninsula, Alaska over multiple years in March 2018 and April 2023. The magnetic data were collected using a Geometrics Inc. G-858 gradiometer and G-857 base station in 2018 and the G-864 gradiometer and G857 base station in 2023. The data was collected (in all instances) by towing the gradiometer behind a snow machine around the watershed with the two sensors in a vertical profile with constant spacing during the continuous survey in that specific year. Magnetic total field measurements were collected by gradiometer and base station, and the data processing was performed in Geometrics MagMap2000 software. The processing steps were limited to removal of data spikes (despiking), reading dropouts, and correction/removal of bad GPS points. All offsets between sensors and GPS are stated within the data files and metadata, alongwith the processed and raw data. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).In this data submission there are two sets of raw magnetic data (.bin and .stn for 2018 and base for 2023; raw rover mag for 2023 is in .csv) inside two .zip files that identify the year the mag data was collected. The data are proprietary format to Geometrics and can be opened and processed with MagMap2000 which can be downloaded for free at Geometrics website. There are also two processed data files *.csv for each year and two metadata files *.csv.

54 ENVIRONMENTAL SCIENCES↗

Agent-based modeling of microbes in space

Space is tough on organisms. Microorganisms traveling to space experience stress from environmental features such as ionizing radiation and lack of normal microgravity; however, much remains unknown about the mechanisms by which those environmental features affect microbial physiology. Microbes experience changes in gravity not directly but rather through changes in their fluid environment, and deep-space particle radiation causes cell damage that is complex but rare. Computational modeling at the single-cell level (agent-based modeling) can allow us to probe the spatially heterogeneous processes that characterize space stresses, to gain insight into the relationships of microbial cells with their environments and with each other. Here we present two software packages for simulating microbial population dynamics in space conditions: CAMDLES and AMMPER. Microbes growing in liquid culture medium in the microgravity of an orbital space station experience a quiescent, poorly-mixed fluid environment. CAMDLES (CFD-DEM Artificial Microgravity Developments for Living Ecosystem Simulation) simultaneously simulates biological, chemical, and mechanical processes to predict microbial ecological dynamics in microgravity, and in the rotating culture vessels used to create an artificial microgravity environment in the lab. Initial results demonstrate that the growth of a cross-feeding microbial consortium, dependent on the exchange of soluble metabolites, is sensitive to the initial spatial distribution of cells, and grows differently in real versus artificial microgravity. Microbial populations exposed to deep-space radiation experience spatially and temporally heterogeneous damage from the traversal of high-energy particles. AMMPER (Agent-Based Model for Microbial Populations Exposed to Radiation) pairs a 3d model of energy deposition along a radiation particle track with a microbial population growth and damage model to predict the effects of localized radiation damage on population-level responses. It includes a user-friendly graphical interface. AMMPER results agree with experimental data indicating that indirect effects of radiation (reactive oxygen species generation, metabolic impairment) have a greater impact on microorganisms than direct effects (DNA damage).

Jessica A Lee↗

Agent-Based Modeling of Microbes in Space

Space is tough on organisms. Microorganisms traveling to space experience stress from environmental features such as ionizing radiation and lack of normal gravity, and much remains unknown about the mechanisms by which those environmental features affect microbial physiology. Microbes experience changes in gravity not directly but rather through changes in their fluid environment, and deep-space particle radiation causes cell damage that is complex but rare. Computational modeling at the single-cell level (agent-based modeling) can allow us to probe the spatially heterogeneous processes that characterize space stresses, to gain insight into the relationships of microbial cells with their environments and with each other. Here we present two software packages for simulating microbial population dynamics in space conditions: CAMDLES and AMMPER. Microbes growing in liquid culture medium in the microgravity of an orbital space station experience a quiescent, poorly-mixed fluid environment. CAMDLES (CFD-DEM Artificial Microgravity Developments for Living Ecosystem Simulation) simultaneously simulates biological, chemical, and mechanical processes to predict microbial ecological dynamics in microgravity, and in the rotating culture vessels used to create an artificial microgravity environment in the lab. Initial results demonstrate that the growth of a cross-feeding microbial consortium, dependent on the exchange of soluble metabolites, is sensitive to the initial spatial distribution of cells, and grows differently in real versus artificial microgravity. Microbial populations exposed to deep-space radiation experience spatially and temporally heterogeneous damage from the traversal of high-energy particles. AMMPER (Agent-Based Model for Microbial Populations Exposed to Radiation) pairs a 3d model of energy deposition along a radiation particle track with a microbial population growth and damage model to predict the effects of localized radiation damage on population-level responses. It includes a user-friendly graphical interface. AMMPER growth curves recapitulate experimental results, and allow comparison between direct effects (DNA damage) and indirect effects (reactive oxygen species generation, metabolic impairment) of radiation.

microbiology↗

Privacy Preserving Federated Learning for Advanced Scientific Ecosystems

We present a framework to provide privacy preserving (PP) federating learning (FL) across multiple computational and experimental facilities. This work joins the compute capabilities of National Energy Research Scientific Computing Center (NERSC) and Oak Ridge National Laboratory Research Cloud (ORC) with simulated experimental data, such as those produced at the SLAC National Accelerator Laboratory and Spallation Neutron Source (SNS). We describe the software infrastructure developed to provide privacy for computational and experimental networks. We developed algorithmic privacy across the federated system by embedding database security, computation, and communication into the federation architecture, utilizing scientific tools developed by the experimental community.

Archibald, Rick [ORNL] (ORCID:0000000245389780)↗