Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Visualization community”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Flexible visualization of a 3rd party Intrusion Prevention (Security) tool: A use case with the ELK stack

A difficult aspect of cyber security is the ability to achieve automated real time intrusion prevention across various sets of systems. To this extent, several companies are offering comprehensive solutions that leverage an "accuracy of scale" and moving much of the intelligence and detection on the Cloud, relying on an ever-growing set of data and analytics to increase decision accuracy. Often, they provide tools to visualize the decision workflows in attack prevention (as well as tune the algorithm) but those solutions are not always practical as companies see the problem as "global" that is, from a unified Cyber-security standpoint. However, a key to a successful Cyber-security program is transparency and trust: from an experimental team viewpoint, this specifically means having the ability to immediately see what and from where, who has been blocked and being able to inform the community in case of a revoked access without the need for filing a "ticket" (that may eventually be answered) – in other words, rapid response to their user-base is essential but solutions targeting "sub-groups" in an organization are not often available. We have come up with a versatile solution leveraging the ELK stack (Elasticsearch, Logstash, & Kibana) and an IPS (Intrusion Prevention System) based WAF (Web Application Firewall) from Signal Sciences. Signal Science allows the streaming of detailed logs in a Logstash format suitable for custom solutions for visualization. By combining these two tools, we have strengthened our security posture and enabled individual experiments to monitor their own traffic. Specifically, the IPS WAF provides unique data such as country of origin, protocol, response code, source IP, and paths accessed. In this contribution, we will show how we engineered a visualization solution so experiment groups could access a dashboard with predefined graphs but also, where they can create individual customizable dashboards used to display blocked traffic and troubleshoot latency issues. We will discuss the details and procedures for developing and configuring these tools and how it benefits cyber security postures across our scientific based environment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Residential Solar-Adopter Income and Demographic Trends: 2024 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 4.1 million residential rooftop solar systems installed through 2023, representing 87% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: -The median income of households that installed solar in 2023 was about $\$$115k/year, compared to a U.S. median of $\$$75k/year for all households and $\$$94k/year for all U.S. owner-occupied households. -Compared to owner-occupied households in the same state, 2023 solar-adopter incomes were 7% higher in the median case, and in 10 states, median solar-adopter incomes were below the corresponding median income for all owner-occupied households. -Roughly 49% of solar adopters in 2023 had incomes below 120% of their area median income (AMI), a threshold sometimes used to define “low-and-moderate income” (or LMI), while 26% were below 80% of AMI, often used to define “low-income”. -Solar adoption continues to shift toward less affluent households over time, with the median present-day income of solar adopters dropping from $\$$141k for households that installed systems in 2010 to $\$$115k in 2023. -PV systems installed in 2023 by households earning less than $\$$50k had a median size of 6.4 kW, 33% were third-party owned, and 6% included battery storage, compared to corresponding values of 8.0 kW, 18%, and 14% for households earning more than $\$$200k. -Compared to all households in their respective state, solar adopters in 2023 were slightly more likely to be college educated and to live in rural areas; had higher home values; and were more likely to live outside a disadvantaged community (DAC), be middle-aged, identify as non-Hispanic white, work in a business or financial occupation, and own a single-family home. In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households; requests for analytical support may be submitted through this online form.

14 SOLAR ENERGY↗
DOE OSTI2025

Machine-learning-enabled on-the-fly analysis of RHEED patterns during thin film deposition by molecular beam epitaxy

Thin film deposition is a fundamental technology for the discovery, optimization, and manufacturing of functional materials. Deposition by molecular beam epitaxy (MBE) typically employs reflection high-energy electron diffraction (RHEED) as a real-time in situ probe of the growing film. However, the state-of-the-art for RHEED analysis during deposition requires human observation. Here, we present an approach using machine learning (ML) methods to monitor, analyze, and interpret RHEED images on-the-fly during thin film deposition. In the analysis workflow, RHEED pattern images are collected at one frame per second and featurized using a pretrained deep convolutional neural network. The feature vectors are then statistically analyzed to identify changepoints; these changepoints can be related to changes in the deposition mode from initial film nucleation to a transition regime, smooth film deposition, and in some cases, an additional transition to a rough, islanded deposition regime. The feature vectors are additionally analyzed via graph analysis and community classification. The graph is quantified as a stabilization plot, and we show that inflection points in the stabilization plot correspond to changes in the growth regime. The full RHEED analysis workflow is termed RHAAPsody and includes data transfer and output to a visual dashboard. We demonstrate the functionality of RHAAPsody by analyzing the precaptured RHEED images from epitaxial depositions of anatase TiO2 on SrTiO3(001) and show that the analysis workflow can be executed in less than 1 s. Our approach shows promise as one component of ML-enabled real-time feedback control of the MBE deposition process.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Hyperspectral remote sensing-based plant community map for region around NGEE-Arctic intensive research watersheds at Seward Peninsula, Alaska, 2017-2019

Using airborne hyperspectral remote sensing data from NASA Airborne Visible-Infrared Imaging Spectrometer- Next Generation (AVIRIS-NG) platforms in a region near NGEE-Arctic intensive watersheds at Seward peninsula of Alaska, high resolution (5m) maps of plant community distribution were developed and included in this data collected. AVIRIS-NG data collected over 2017-2019 period were used to develop deep neural networks, trained using vegetation plot observations collected at NGEE-Arctic watersheds at Kougarok, Council and Teller. A hierarchical vegetation classification scheme consisting of six classes at Level I, and 16 classes at Level II contained in two .txt files were used to developed the plant community maps for the region. Two geospatial raster data files (.tif) at both thematic levels are shared in this data collection. Data files in this collection use Alaska Albers Equal Area projection. Readme files available in three formats (*.html, *.md, *.pdf) and one *.png visualization map.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Influence of Lake Ice Biases in Reanalysis Data on Downscaled Climate Simulations over the Great Lakes Region

This data package contains observation-based and model-simulated datasets (all provided in NetCDF format) for evaluating how wintertime lake-ice representation affects regional weather and climate over the Laurentian Great Lakes (freshwater lake ecosystem) during the high–ice-cover winter of 2009. The observational component includes: (1) Stage IV gridded precipitation at 4 km, hourly resolution for January–February 2009 over the Great Lakes region (radar–gauge multisensor precipitation analyses); (2) Great Lakes Surface Environmental Analysis (GLSEA) satellite-derived lake-ice coverage at 1.3 km, daily resolution for the 2009 winter months, providing ice coverage over Lakes Superior, Michigan, Huron, Erie, and Ontario; and (3) in situ measurements at the Standard Rock site on Lake Superior from the Great Lakes Evaporation Network (GLEN) at hourly resolution, including near-surface atmospheric variables and sensible and latent heat fluxes (air–lake exchange) at a fixed point location. The modeling component provides corresponding fields from two simulations, both archived at 4 km, hourly resolution: a standalone Weather Research Forecasting model (WRF) run driven by the European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis 5 (ERA5), and a two-way coupled model using WRF and the Finite Volume Community Ocean Model (WRF-FVCOM, a 3-D hydrodynamic lake model). These outputs include variables relevant to air–lake interaction and lake-effect processes (e.g., near-surface temperature, humidity, wind, precipitation, and surface turbulent fluxes), enabling direct comparison with the observational datasets. Users can analyze and visualize these NetCDF files with common tools such as Python (e.g., xarray, netCDF4, numpy, pandas), NCO/CDO, Panoply, or ncview; NetCDF variables can also be converted to other formats (e.g., CSV, GeoTIFF) using these utilities.

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗
DOE OSTI2025

Landscaper v1

Understanding the inner workings of machine learning models through their loss landscapes offers crucial insights into model properties, optimization dynamics, and generalizability. However, accessing these insights has traditionally required specialized mathematical expertise, limiting broader adoption. Landscaper is an open-source Python package designed to bridge this gap. Landscaper seamlessly integrates a suite of multi-dimensional loss landscape analyses with cutting-edge topological data analysis (TDA) methods. This powerful combination makes both fundamental loss landscape analysis and advanced TDA techniques accessible to the broader scientific ML community, without requiring deep pre-existing mathematical knowledge. Landscaper offers three key functionalities: * Construction: Builds detailed loss landscape representations through versatile low and high-dimensional sampling techniques. * Quantification: Applies advanced metrics, including a novel topological data analysis (TDA) based smoothness metric, enabling new perspectives on model behavior. * Visualization: Offers intuitive tools to visualize and interpret loss landscapes, providing actionable insights beyond traditional performance metrics.

Weber, Gunther [Lawrence Berkeley National Laborat↗
DOE OSTI2020

NGEE Arctic Plant Traits: Plant Community Composition, Kougarok Road Mile Marker 64, Seward Peninsula, Alaska, 2016

This dataset reports the characteristics of the dominant vegetation communities at the NGEE Arctic Kougarok field site, Kougarok Road Mile Marker 64 on the Seward Peninsula. Selected plots were surveyed from 18-23 July 2016. Environmental data (e.g., elevation, slope, soil moisture regime, disturbance type and degree, mean canopy height, etc.) were also recorded for each plot. Elevation measurements were updated 2020-08-18. All plant species (vascular plants, bryophytes and lichens) were recorded along with their percent cover in the plots as determined visually by the lead author. Plots were chosen subjectively in areas of homogeneous and representative vegetation and varied in size from 1-25 m2 depending on canopy structure and height. The site is an east-facing hillslope with vegetation that varies from the summit to the toeslope. The 30 total plots were selected as five replicate plots sampled from each of the six identified habitat types: 1) non-acidic mountain complex at the hillcrest, 2) dwarf-shrub lichen tundra on the shoulder, 3) alder shrublands predominantly on an elevational band across the backslope, 4) willow-birch tundra on the upper backslope, 5) tussock tundra on the footslope in inter-water tracks, and 6) tussock tundra mixed with willow-birch tundra or alder savanna in poor developed water tracks on the footslope. This dataset is comprised of two comma-separated (*.csv) files containing species and environmental data for the plant community composition plots. It also contains seven zipped folders of plot photographs, one map showing plot locations (*.pdf), one blank datasheet with the key to codes used in the field (*.pdf), select photos organized in a (*.pdf), and one User file (*.pdf). The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

pmartR 2.0 : A Quality Control, Visualization, and Statistics Pipeline for Multiple Omics Datatypes

The pmartR (https://github.com/pmartR/pmartR) package was designed for the quality control (QC) and analysis of mass spectrometry (MS) data, tailored to specific characteristics of proteomic (isobaric or labelled), metabolomic, and lipidomic datasets. Since its initial release, the tool has been expanded to address the needs of its growing userbase and now includes QC and statistics for nuclear magnetic resonance (NMR) metabolomic data, and leverages the DESeq2, edgeR, and limma-voom R packages for some transcriptomic data analyses. These improvements have made progress towards a unified omics processing pipeline for ease of reporting and streamlined statistical purposes. The package’s statistics and visualization capabilities have also been expanded by adding support for paired data and by integrating pmartR with the trelliscopejs R package for the quick creation of trellis displays (https://github.com/hafen/trelliscopejs). Here, we present relevant examples of each of these enhancements to pmartR and highlight how each new feature benefits the omics community.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

EDX ClaiMM: Digital Resources for the Critical Minerals and Materials Community

Securing critical mineral supply chains is essential for transitioning to a clean energy economy and for maintaining national security. Big-data analytics can serve as a cost-effective means of identifying new domestic critical mineral resources but only if data can be easily located and digested. Using ArcGIS Enterprise Sites, EDX ClaiMM was developed to increase the accessibility of critical minerals data, reducing time spent on data collection and integration. Hosted tools provide rapid visualization and exploration of key datasets, unlocking insights to support resource assessments.

Yesenchak, Rachel↗
DOE OSTI2026

Visual Systems Mapping to Define and Compare Woody Biomass LCAs for Sustainable Systems

The challenge addressed in this research centres on the need to choose between several biomass sources and energy production processes, while supporting rural economies and resilience of forest systems. A key barrier to effective decision-making for strategies using biomass is the lack of standardized and transparent life cycle assessment (LCA) baselines. These baselines are critical for assessing the impacts of biomass strategies but often vary due to regional factors and chosen simplifying assumptions of the LCAs. However, omitting key variables can mean the LCA omits key feedback and balancing loops relevant to fully assessing impacts of the change or test scenario. To address these complexities, this project employs a systems engineering approach: visual systems mapping. This technique is used to define the boundaries and dynamic behaviours of LCA baselines, enhancing transparency. By examining five literature sources and their documented baseline scenarios, the systems mapping case-studies demonstrates an approach to documenting and archiving these baselines. Recommendations are that visual systems mapping should be used to document key assumptions, such as baselines, of LCAs. Further, where possible open data repositories should hold key information about LCA baselines and reproducible workflows (e.g., using open-source tools) should be used to improve transparency and comparability in LCAs. Given the consensus within the broader scientific community on the importance of replicable data practices, this research reinforces the need for standardized frameworks and systems engineering tools in LCAs. This research demonstrates a pathway to more transparent, standardized, and comparable LCAs, that may bolster decisions for biomass systems.

Davis, Maggie [ORNL] (ORCID:0000000181319328)↗
DOE OSTI2023

Metaoptics Enabled Multifunctional Imaging

Despite the fact that most microorganisms occupy two- and three-dimensional space in heterogeneous arrangements and in proximity to other microorganisms of different species, much of our current knowledge about their metabolic processes is derived from homogenizing, then analyzing, the chemical content of cultures containing a single microbial species. This project addressed this fundamental dichotomy by developing a set of optical imaging principles combining multiple new technologies. The imaging strategies developed in this project combine metaoptics structures with active in situ nanoscale control of the chemical environment and applied them to a microbial system, Myxococcus xanthus, with particular relevance to the DoE mission. The combination of metaoptical architectures and nanoscale control over the molecular environment enables: (a) precise control over the electromagnetic (EM) field at length scales smaller than the wavelength of light; (b) control of the interaction of the EM field with critical molecular systems in DOE relevant microbes; (c) control over the chemical environment – especially the presence and quantity of reactive oxygen species (ROS) that can affect redox homeostasis; and (d) the ability to ask new kinds of questions not accessible to ‘omics’ approaches or standard methods of biological imaging. These capabilities are applicable to detailed studies of metabolic pathways in microbes and to lignocellulosic biomass deconstruction. To accomplish these objectives, we pursued two over-arching technical goals: (1) the development of new metaoptics-enabled approaches to imaging and spectroscopic characterization; and (2) the development of tools to control the chemical environment of a microbial sample with nanometer-scale precision. Goal 1 was addressed through the design, fabrication, and characterization of new metasurfaces capable of super-resolution imaging through extreme confinement of the optical field. Goal 2 was addressed by controlling the redox potential on the nanoscale in microbial communities and characterizing their effect on intrinsic bacterial fluorophores which act as molecular sentinels and through characterization of soluble factors secreted by Myxococcus xanthus by confocal Raman imaging. The optical imaging/sensing approaches developed here make it possible to use these powerful new imaging and sensing modalities in metabolic studies by making it possible to visualize and track the spatial and temporal expression patterns of natural or engineered pathways in microorganisms.

09 BIOMASS FUELS↗
DOE OSTI2020

Dalton Project: A Python platform for molecular- and electronic-structure simulations of complex systems

The Dalton Project provides a uniform platform access to the underlying full-fledged quantum chemistry codes Dalton and LSDalton as well as the PyFraME package for automatized fragmentation and parameterization of complex molecular environments. The platform is written in Python and defines a means for library communication and interaction. Intermediate data such as integrals are exposed to the platform and made accessible to the user in the form of NumPy arrays, and the resulting data are extracted, analyzed, and visualized. Complex computational protocols that may, for instance, arise due to a need for environment fragmentation and configuration-space sampling of biochemical systems are readily assisted by the platform. The platform is designed to host additional software libraries and will serve as a hub for future modular software development efforts in the distributed Dalton community.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Herbivorous Fish Microbiome Adaptations to Sulfated Dietary Polysaccharides

Marine herbivorous fish that feed primarily on macroalgae, such as those from the genus Kyphosus, are essential for maintaining coral health and abundance on tropical reefs. Here, deep metagenomic sequencing and assembly of gut compartment-specific samples from three sympatric, macroalgivorous Hawaiian kyphosid species have been used to connect host gut microbial taxa with predicted protein functional capacities likely to contribute to efficient macroalgal digestion. Bacterial community compositions, algal dietary sources, and predicted enzyme functionalities were analyzed in parallel for 16 metagenomes spanning the mid- and hindgut digestive regions of wild-caught fishes. Gene colocalization patterns of expanded carbohydrate (CAZy) and sulfatase (SulfAtlas) digestive enzyme families on assembled contigs were used to identify likely polysaccharide utilization locus associations and to visualize potential cooperative networks of extracellularly exported proteins targeting complex sulfated polysaccharides. These insights into the gut microbiota of herbivorous marine fish and their functional capabilities improve our understanding of the enzymes and microorganisms involved in digesting complex macroalgal sulfated polysaccharides.

09 BIOMASS FUELS↗
DOE OSTI2023

Wildfire Risk Evaluation Framework for Grid Operations and Planning

The United States (US) environmental protection agency's (EPA's) climate change indicators for wildfires show a long-term trend of increased annual wildfire activity, larger wildfire size, and more variable dynamics in wildfire behavior. This has caused more frequent preemptive public safety power shutoff (PSPS) events in the regions with recognized high wildfire risk. These preemptive power shutoffs attempt to prevent the ignition of a wildfire but it nonetheless renders the transmission line non-operational, which often sheds load of downstream communities. As wildfires and PSPS events become more frequent, it is crucial to find the communities most at risk of load shedding. To that end, this paper proposes the wildfire risk evaluation of the system (WiRES) framework, which is a performance-based framework that translates extreme weather-related and PSPS event probabilities into a cumulative probability of a non-operational transmission line. This study also provides a geospatial visualization tool that breaks down the entire western electrical coordinating council (WECC) region into 50 km grid cells which can be used to 1) filter out transmission lines with higher than a threshold outage probability, and 2) graphically discover the affected regions and their biophysical and socioeconomic metrics. %such as the social vulnerability index, population density, gross domestic product, etc. Lastly, an impact assessment study is conducted which connects the results of the proposed framework to python and powerworld-based contingency analysis to highlight the applicability of the framework.

Wildfire, Resilience, Extreme Events, Grid Reslien↗
DOE OSTI2020

Scalable, resilient, and configurable permissioned blockchain fabric

With the advent of Bitcoin, the interest of the database community in blockchain systems has steadily grown. Many existing blockchain applications use blockchains as a platform for monetary transactions, however. We deviate from this philosophy and present ResilientDB, which can serve in a suite of non-monetary data-processing blockchain applications. Our ResilientDB uses state-of-the-art technologies and includes a novel visualization that helps in monitoring the state of the blockchain application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Automating Traffic Microsimulation from SYNCHRO UTDF to SUMO

Modern transportation research relies on seamlessly integrating traffic signal data with robust network representation and simulation tools. This study presents utdf2gmns, an open-source Python tool that automates conversion of the Universal Traffic Data Format, including network representation, signalized intersections, and turning volumes into the General Modeling Network Specification (GMNS) Standard. The resulting GMNS-compliant network can be converted for microsimulation in SUMO. By automatically extracting intersection control parameters and aligning them with GMNS conventions, utdf2gmns minimizes manual preprocessing and data loss. utdf2gmns also integrates with the Sigma-X engine to extract and visualize key traffic control metrics, such as phasing diagrams, turning volumes, volume-tocapacity ratios, and control delays. This streamlined workflow enables efficient scenario testing, accurate model building, and consistent data management. Validated through case studies, utdf2gmns reliably models complex urban corridors, promoting reproducibility and standardization. Documentation is available on GitHub and PyPI, supporting easy integration and community engagement.

Luo, Roy [ORNL] (ORCID:0009000312909983)↗
DOE OSTI2024

Water & Energy Interdependencies Across Economic Sectors of the United States

The motivation of the Integrated Water Power Resilience Project is to identify and develop opportunities for improving resilience in the water and power sectors through coordinated planning, investment, and operations and thereby provide benefits to power and water utilities, consumers, and the environment. Water and power systems are interdependent, subject to many of the same natural and manmade hazards, and are critical for the well-being of communities and society. Because of the interconnectedness of water and power systems, there are substantial economic, social, and environmental benefits to co-managing the market sectors for resilience instead of managing them separately. To support this initiative and future research in this area, a county level water and energy flow dataset was developed to build, calculate, and visualize interconnections in water and energy between various sectors. This report presents county and regional water and energy visualizations across nine economic sectors of the United States: agriculture, commercial, electricity generation, industrial, mining, public water supply, residential, transportation, and wastewater treatment.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗