Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data exploration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Hyper Suprime-Cam Legacy Archive

Abstract We present the launch of the Hyper Suprime-Cam Legacy Archive (HSCLA), a public archive of processed, science-ready data from the Hyper Suprime-Cam (HSC). HSC is an optical wide-field imager installed at the prime focus of the Subaru Telescope and has been in operation since 2014. While ∼1/3 of the total observing time of HSC has been used for the Subaru Strategic Program (SSP), the remainder of the time is used for Principal Investigator (PI)-based programs. We have processed the data from these PI-based programs and make the processed, high-quality data available to the community through HSCLA. The current version of HSCLA includes data taken in the first year of science operation, 2014. We provide both individual and coadd images as well as photometric catalogs. The photometric catalog from the coadd is loaded to the database, which offers a fast access to the large catalog. There are other online tools such as an image browser and an image cutout tool and they will be useful for science analyses. The coadd images reach 24–27th magnitudes at 5σ for point sources and cover approximately 580 square degrees in at least one filter with 150 million objects in total. We perform extensive quality assurance tests and verify that the photometric and astrometric quality of the data is good enough for most scientific explorations. However, the data are not without problems and users are referred to the list of known issues before exploiting the data for science. All the data and documentations can be found at the data release site, 〈https://hscla.mtk.nao.ac.jp/〉.

Tanaka, Masayuki↗

Residential Solar-Adopter Income and Demographic Trends: 2021 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on data for roughly 1.9 million residential rooftop solar systems installed through 2019, representing 82% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: Solar adopters generally skew towards higher incomes, though that trend continues to diminish over time. Solar adopter incomes vary considerably and encompass many low-to-moderate income (LMI) households. Solar-adopter incomes are consistently higher for systems paired with battery storage, for host-owned systems, and for systems installed on single-family homes. Solar adopters differ from the broader U.S. population in terms of a variety of other demographic and socioeconomic measures. State-level comparisons indicate that solar-adopters tend to live in neighborhoods with relatively high non-Hispanic White and Asian populations, and with relatively low Hispanic and Black populations. In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households.

14 SOLAR ENERGY↗

Residential Solar-Adopter Income and Demographic Trends: November 2022 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 2.8 million residential rooftop solar systems installed through 2021, representing 86% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: -Median solar adopter income was about $\$110$k/year in 2021, compared to a U.S. median of about $\$63$k/year for all households and $\$79$k/year for all owner-occupied households -The degree of income skew varies significantly across all states, but all states exhibit some positive income skew, with median solar-adopter incomes ranging from 131-168% of the respective county-median income for all households -Notwithstanding the fact that solar adopter incomes skew high, a substantial share of adopters could be considered low-to-moderate income (LMI), with 22% of all 2021 adopters earning less than 80% of area median income, and an additional 21% between 80% and 120% of area median income. -Solar-adopter incomes are declining over time, with median incomes dropping from $\$129$k in 2010 to $\$110$k in 2021, as adoption becomes more proportionately distributed across the population and has started to broaden into low- and middle-income states since 2016. -Solar-adopter incomes are consistently higher for systems paired with battery storage, for host-owned systems, and for systems installed on single-family homes; higher income adopters also consistently install larger systems. -Solar adopters tend to live in Census Tracts not identified as “disadvantaged communities” (using the U.S. Department of Energy’s interim definitions developed March 2022), making up 11% of adopters compared to 18% of U.S. households. -Compared to the broader population, solar adopters tend to: identify as Non-Hispanic White, be primarily English-speaking, have higher education levels, be middle-aged, work in business and finance-related occupations, and live in higher-value homes In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households; requests for analytical support may be submitted through this online form.

13 HYDRO ENERGY↗

Residential Solar-Adopter Income and Demographic Trends: 2023 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 3.4 million residential rooftop solar systems installed through 2022, representing 86% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: (1) Median solar adopter income was about $\$117$k/year in 2022, compared to a U.S. median of about $\$69$k/year for all households and $\$86$k/year for all owner-occupied households; (2) The degree of income skew varies significantly across all states, but all exhibit some positive income skew relative to all households in the state, with median solar-adopter incomes ranging from 108-180% of the respective state-median income for all households; (3) Roughly 45% of solar adopters in 2022 had incomes below 120% of their area median income (AMI), a threshold sometimes used to define “low-and-moderate income” (or LMI), while 23% were below 80% of AMI, often used to define “low-income”; (4) Solar adoption continues to shift toward less affluent households, with the median current income of solar adopters dropping from $\$140$k for households that installed systems in 2010 to $\$117$k in 2022; (5) PV systems installed in 2022 by households earning less than $50k had a median size of 6.1 kW, 34% were third-party owned, and 5% included battery storage, compared to corresponding values of 7.6%, 17%, and 15% for households earning more than 200 dollars k; and (6) Compared to all households in their respective state, solar adopters tend to be negligibly more rural; have higher home values; and are more likely to be college educated, identify as non-Hispanic white, live outside a disadvantaged community (DAC), be middle-aged, work in a business or financial occupation, and own a single-family home In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households.

14 SOLAR ENERGY↗

Residential Solar-Adopter Income and Demographic Trends: 2024 Update [Slides]

The report describes income, demographic, and other socio-economic trends among U.S. residential rooftop solar adopters. The report is based on address-level data for roughly 4.1 million residential rooftop solar systems installed through 2023, representing 87% of all U.S. systems. With its unique size, geographic scope, and level of detail, this report is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and researchers. Key findings include the following: -The median income of households that installed solar in 2023 was about $\$$115k/year, compared to a U.S. median of $\$$75k/year for all households and $\$$94k/year for all U.S. owner-occupied households. -Compared to owner-occupied households in the same state, 2023 solar-adopter incomes were 7% higher in the median case, and in 10 states, median solar-adopter incomes were below the corresponding median income for all owner-occupied households. -Roughly 49% of solar adopters in 2023 had incomes below 120% of their area median income (AMI), a threshold sometimes used to define “low-and-moderate income” (or LMI), while 26% were below 80% of AMI, often used to define “low-income”. -Solar adoption continues to shift toward less affluent households over time, with the median present-day income of solar adopters dropping from $\$$141k for households that installed systems in 2010 to $\$$115k in 2023. -PV systems installed in 2023 by households earning less than $\$$50k had a median size of 6.4 kW, 33% were third-party owned, and 6% included battery storage, compared to corresponding values of 8.0 kW, 18%, and 14% for households earning more than $\$$200k. -Compared to all households in their respective state, solar adopters in 2023 were slightly more likely to be college educated and to live in rural areas; had higher home values; and were more likely to live outside a disadvantaged community (DAC), be middle-aged, identify as non-Hispanic white, work in a business or financial occupation, and own a single-family home. In conjunction with the report, Berkeley Lab has published an updated accompanying set of online data visualizations that allow users to further explore the underlying data. Berkeley Lab is also offering related analytical support to states, local agencies, and other organizations on issues related to solar adoption among low-to-moderate income households; requests for analytical support may be submitted through this online form.

14 SOLAR ENERGY↗

A National Infrastructure for Artificial Intelligence on the Grid (NI4AI) (Final Scientific/Technical Report)

Electric utilities have traditionally taken a very pragmatic yet myopic approach with grid sensors and the resulting collected data. Sensors are purchased and deployed to solve a specific, known problem that has risen to sufficient awareness as to justify the effort of deploying sensors and the needed capital investment. This sensor data flows into proprietary software packages with limited functionality intended only to address the initial problem. This approach aligns with the financial incentives of the utility to deploy capital into fixed hardware assets for which the corporations earn a rate of return. This mentality stands in stark contrast to the big data revolution that started nearly 25 years ago with the rise of Google. In this worldview, data is a fundamental business asset; successful organizations collect, store, explore, merge, and exploit as much data as possible to not only solve problems well understood today but also to tackle new problems that will inevitably rise tomorrow. The ARPA-E Open Innovation 2018 project entitled A National Infrastructure for Artificial Intelligence on the Grid or NI4AI for short was designed to demonstrate this alternative paradigm for using data. To do this, the project was composed of three key thrust areas. The first major component deployed a variety of high-frequency grid sensors and captured terabytes of both wide-scale and localized grid measurements, generating high-value datasets for grid research and algorithm development. The second aspect made available PingThings’ PredictiveGridTM, a horizontally scalable, cloud-based data management and AI platform built for time series data to explore and exploit the collected data. Finally, the project fostered a diverse and open research community composed of experts from numerous fields through focused educational content, code sharing, and data science competitions. Shifting away from “single use” sensors and closed data silos within electric utilities is a major benefit to the public at large. This legacy approach to data is incredibly (1) capital intensive (new sensors must be deployed for each new problem and problems tend to arise continuously) and (2) painfully slow (new problems must be identified first and then new sensors must be deployed to collect data to begin to address the issue). The transition to a carbon neutral grid requires a massive transformation of the existing grid infrastructure and will continue to challenge the legacy grid in unforeseen ways. The only way to make the energy transition cost effective is for utilities to abandon this dated data paradigm and adopt more contemporary approaches. NI4AI has shown that it is technically possible and economically feasible to ingest, explore, and exploit grid data collected from even very high frequency sensing, such as continuous point on wave sensors collecting measurements 10,000 times a second. In fact, the PredictiveGrid platform used is commercially available and deployed at several utilities in the United States. Project accomplishments were numerous and included (1) making available a state of the art time series platform to the community, (2) collecting over 520 streams of time series data from grid sensors totaling over 1 trillion grid measurements, and (3) developing and nurturing a community within the industry focused on the use of data to create value for utilities and, ultimately, end consumers.

97 MATHEMATICS AND COMPUTING↗

RCSB Protein Data Bank: powerful new tools for exploring 3D structures of biological macromolecules for basic and applied research and education in fundamental biology, biomedicine, biotechnology, bioengineering and energy sciences

Abstract The Research Collaboratory for Structural Bioinformatics Protein Data Bank (RCSB PDB), the US data center for the global PDB archive and a founding member of the Worldwide Protein Data Bank partnership, serves tens of thousands of data depositors in the Americas and Oceania and makes 3D macromolecular structure data available at no charge and without restrictions to millions of RCSB.org users around the world, including >660 000 educators, students and members of the curious public using PDB101.RCSB.org. PDB data depositors include structural biologists using macromolecular crystallography, nuclear magnetic resonance spectroscopy, 3D electron microscopy and micro-electron diffraction. PDB data consumers accessing our web portals include researchers, educators and students studying fundamental biology, biomedicine, biotechnology, bioengineering and energy sciences. During the past 2 years, the research-focused RCSB PDB web portal (RCSB.org) has undergone a complete redesign, enabling improved searching with full Boolean operator logic and more facile access to PDB data integrated with >40 external biodata resources. New features and resources are described in detail using examples that showcase recently released structures of SARS-CoV-2 proteins and host cell proteins relevant to understanding and addressing the COVID-19 global pandemic.

59 BASIC BIOLOGICAL SCIENCES↗

Income Trends among U.S. Residential Rooftop Solar Adopters [Slides]

Berkeley Lab tracks and analyzes solar-adopter demographic characteristics. A central element of this work is an annual report describing income trends of residential solar adopters over time and across geographies. The report is based on household-level income estimates for single-family residential solar adopters across the United States, and is intended to serve as a foundational reference document for policy-makers, industry stakeholders, and other researchers interested in demographic trends among residential solar adopters. The report is published with an accompanying interactive data visualization tool that allows users to further explore the underlying data. In addition to the annual report, Berkeley Lab also conducts targeted topical analyses on issues related to solar-adopter demographics and provides direct analytical support to organizations working to expand access to solar energy among low-to-moderate income households.

14 SOLAR ENERGY↗

Automating Analysis of Neutron Scattering Time-of-Flight Single Crystal Phonon Data

This article introduces software called Phonon Explorer that implements a data mining workflow for large datasets of the neutron scattering function, S(Q, ω), measured on time-of-flight neutron spectrometers. This systematic approach takes advantage of all useful data contained in the dataset. It includes finding Brillouin zones where specific phonons have the highest scattering intensity, background subtraction, combining statistics in multiple Brillouin zones, and separating closely spaced phonon peaks. Using the software reduces the time needed to determine phonon dispersions, linewidths, and eigenvectors by more than an order of magnitude.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Molecular Hypernetworks for Exploration of Multi-Dimensional Metabolomics Data (Chyper)

Orthogonal separations of data from high-resolution mass spectrometry can provide insight into sample composition and help address the challenge of complete annotation of molecules in untargeted metabolomics. “Molecular networks” (MNs), as used, for example, in the Global Natural Products Social Molecular Networking platform, are an increasingly popular computational strategy for exploring and visualizing molecular relationships and improving annotation. MNs use graph representations to show the relationships between measured multidimensional data features. MNs also show promise for using network science algorithms to automatically identify targets for annotation candidates and to dereplicate features associated to a single molecular identity. However, more advanced methods may better represent the complexity present in samples. Our work aims to increase confidence in annotation propagation by extending molecular network methods to include “molecular hypernetworks” (MHNs), able to natively represent multiway relationships among observations supporting both human and analytical processing. In this paper we first introduce MHNs illustrated with simple examples, and demonstrate how to build them from liquid chromatography- and ion mobility spectrometry- separated MS data. We then describe a method to construct MHNs directly from existing MNs as their “clique reconstructions”, demonstrating their utility by comparing examples of previously published graph-based MNs to their respective MHNs.

59 BASIC BIOLOGICAL SCIENCES↗

Coso Geothermal Spectral Library for Rocks and Minerals

An integrated open mineral spectral library designed to enhance the utility and precision of mineral spectral data for geothermal exploration, developed from a reliable and comprehensive digital dataset for seamless sharing by integrating field data, the USGS spectral library, and pertinent information obtained from Coso geothermal field (Coso) in California. The ASD FieldSpec portable spectrometer was utilized for collecting spectral data, which was subsequently analyzed using the THOR Material Identification tool in ENVI, The Spectral Geologist (TSG) software by CSIRO, and the Fully Constrained Linear Spectral Unmixing algorithm (FCLSU) in MATLAB. Scanning Electron Microscopy (SEM) with a mineralogy-analyzing function was employed to assess the mineral composition of samples, ensuring precise mineralogical analysis. A portable X-ray fluorescence (pXRF) spectrometer was also utilized to gather information on elemental enrichment. A framework for developing spectra data and establishing spectral libraries for various geological cases was proposed within this study. The characteristic spectra of six alteration minerals - alunite, chalcedony, epidote, hematite, kaolinite, and opal - were acquired from Coso samples. The spectral library for the Coso alteration minerals was introduced for further application in academic study or industrial exploration. To browse the Coso Geothermal Spectral data and related figures from spreadsheets: #1 Unzip and store the following items in the same folder. 'Contact Probe Data.zip', 'Sample Photos.zip', and 'Coso spectra of higher-certainity minerals.xlsx'. #2 Open 'Coso spectra of higher-certainity minerals.xlsx'. The hyperlinks in the spreadsheet lead to the folders or figures of: spectra .asd file, spectra ASC II file, spectra plots, and sample photos. The spectra data is raw data without splice correction. Spectra .asd files require particular software to open. (These cannot be opened in GIS software such as ArcGIS.) Spectra ASC II files can be opened in a text editor or spread sheet program.

15 GEOTHERMAL ENERGY↗

My vehicle is a data mine

In this talk we explore how analysis of vehicle data provides information of individual vehicle behaviors, information of other vehicles in the flow of traffic, and insights into the behavior of drivers. Over the last two decades traditional passenger vehicles have been transformed from integrated two-port electrical nodes to cyber-physical systems of communicating computational nodes whose individual state and control variables are shared on a standard controller area network (CAN) bus. As driver assistance systems have crept into vehicles as safety features, driver behaviors can be observed through analysis of the data streams on the CAN bus as these new nodes communicate with one another. The properties of these data streams, as well as architectures and approaches to gather the data, are important to consider when drawing conclusions on the relevance of the data in making decisions at varying levels of the information hierarchy. We will demonstrate several technical challenges associated with these data collection processes, as well as preliminary results that demonstrate application relevance of the data to behavior, traffic, and systems domains.

42 ENGINEERING↗

Developing a Mapping Inquiry Tool and Geodatabase to Support Characterization of Candidate Geologic Carbon Storage Sites

Poster to showcase the Class VI Mapping Inquiry Tool (C6 MapIT) and support geodatabase available on EDX. C6 MapIT and the underpinning Class VI Data Support Tool Geodatabase serve as comprehensive resources to aid with understanding data availability and supporting the initial stages of Class VI siting and permit applications. In addition to enabling users to explore available spatial data, additional resources are provided to empower users to find more information, such as links to documentation to support project goals, a query tool for USGS publications, and links to relevant sections of the EPA Class VI documentation. Safe and appropriate selection of UIC Class VI well sites is key as the U.S. makes the energy transition. The Class VI Mapping Inquiry Tool and Class VI Data Tool Geodatabase are valuable, intuitive resources that empower commercial and industry stakeholders to explore, analyze, and acquire Class VI related data.

Pantaleone, Scott↗

RCSB Protein Data Bank: supporting research and education worldwide through explorations of experimentally determined and computationally predicted atomic level 3D biostructures

The Protein Data Bank (PDB) was established as the first open-access digital data resource in biology and medicine in 1971 with seven X-ray crystal structures of proteins. Today, the PDB houses >210 000 experimentally determined, atomic level, 3D structures of proteins and nucleic acids as well as their complexes with one another and small molecules ( e.g. approved drugs, enzyme cofactors). These data provide insights into fundamental biology, biomedicine, bioenergy and biotechnology. They proved particularly important for understanding the SARS-CoV-2 global pandemic. The US-funded Research Collaboratory for Structural Bioinformatics Protein Data Bank (RCSB PDB) and other members of the Worldwide Protein Data Bank (wwPDB) partnership jointly manage the PDB archive and support >60 000 `data depositors' (structural biologists) around the world. wwPDB ensures the quality and integrity of the data in the ever-expanding PDB archive and supports global open access without limitations on data usage. The RCSB PDB research-focused web portal at https://www.rcsb.org/ (RCSB.org) supports millions of users worldwide, representing a broad range of expertise and interests. In addition to retrieving 3D structure data, PDB `data consumers' access comparative data and external annotations, such as information about disease-causing point mutations and genetic variations. RCSB.org also provides access to >1 000 000 computed structure models (CSMs) generated using artificial intelligence/machine-learning methods. To avoid doubt, the provenance and reliability of experimentally determined PDB structures and CSMs are identified. Related training materials are available to support users in their RCSB.org explorations.

59 BASIC BIOLOGICAL SCIENCES↗

Artificial neural network potentials for mechanics and fracture dynamics of two-dimensional crystals **

Understanding the mechanics and failure of materials at the nanoscale is critical for their engineering and applications. The accurate atomistic modeling of brittle failure with crack propagation in covalent crystals requires a quantum mechanics-based description of individual bond-breaking events. Artificial neural network potentials (NNPs) have emerged to overcome the traditional, physics-based modeling tradeoff between accuracy and accessible time and length scales. Previous studies have shown successful applications of NNPs for describing the structure and dynamics of molecular systems and amorphous or liquid phases of materials. However, their application to deformation and failure processes in materials is still uncommon. In this study, we discuss the apparent limitations of NNPs for the description of deformation and fracture under loadings and propose a way to generate and select training data for their employment in simulations of deformation and fracture simulations of crystals. We applied the proposed approach to 2D crystalline graphene, utilizing the density-functional tight-binding method for more efficient and extensive data generation in place of density functional theory. Then, we explored how the data selection affects the accuracy of the developed artificial NNPs. It revealed that NNP’s reliability should not only be measured based on the total energy and atomic force comparisons for reference structures but also utilize comparisons for physical properties, e.g. stress–strain curves and geometric deformation. In sharp contrast to popular reactive bond order potentials, our optimized NNP predicts straight crack propagation in graphene along both armchair and zigzag (ZZ) lattice directions, as well as higher fracture toughness of ZZ edge direction. Our study provides significant insight into crack propagation mechanisms on atomic scales and highlights strategies for NNP developments of broader materials.

2D materials↗

2023 Data Science Challenge Notebooks

THE DATA SCIENCE INSTITUTE WILL BE INVITING STUDENTS FROM UC MERCED AND UC RIVERSIDE TO PARTICIPATE IN A DATA SCIENCE CHALLENGE AT LLNL. IN THE CHALLENGE, THE STUDENTS WILL EXPLORE A DATA-DRIVEN APPROACH TO RECONSTRUCTING ELECTROANATOMICAL MAPS OF THE HEART AT CLINICALLY RELEVANT RESOLUTIONS, COMBINING INPUT FROM THE STANDARD 12-LEAD ECG WITH ADVANCED MACHINE LEARNING TECHNIQUES. THE DATA THE STUDENTS WILL HAVE ACCESS TO HAS BEEN IM REVIEWED FOR EXTERNAL RELEASE. (LLNL-MI-835833) THESE NOTEBOOKS WILL PROVIDE THE STUDENTS WITH INSTRUCTIONS OF HOW TO LOAD THE DATA AND WORK WITH THE DATA, ALONG WITH TUTORIALS TO DO BASIC MACHINE LEARNING TASKS LIKE LOGISTIC REGRESSION AND IMAGE CLASSIFICATION.

Landajuela Larma, Mikel↗

Carbon Storage Site Mapping Inquiry Tool (MapIT)

To date, 48 projects, consisting of 139 wells, are currently under review with the Environmental Protection Agency’s (EPA) Underground Injection Control (UIC) Program for Class VI – wells used for geologic sequestration of carbon dioxide. The number of applications submitted is expected to increase in coming years with the increase of the 45Q tax credit available to projects that initiate construction prior to 2033. The amount of data collected to submit a Class VI permit is vast, and often disparate, coming from state, federal, and commercial entities, as well as field-specific data collected within an area of interest. When preparing for site selection and permitting, the initial aggregation of relevant public data can be time intensive. The Carbon Storage Site Mapping Inquiry tool (MapIT) was created to support and accelerate the discovery and accessibility of open-source data and information available across the USA. Data was aggregated and organized based on data types described within the EPA UIC Class VI permit documentation. The online tool enables users to explore hundreds of geospatial data layers and connect to additional external resources, leveraging API and REST services where possible to ensure updates to data in real time. MapIT enables users to explore state and federal data related to geologic, geophysical, structural, hydrologic, and contextual information. In addition to displaying spatial data and linking to external resources, MapIT leverages custom widgets to ensure that internal data and external data are discoverable and accessible. The widgets connect users to resources such as the USGS publications and the USGS Earthquake Catalog based on a user-defined location. This talk will describe data aggregation workflows, data types, data preparation, and tool development for MapIT. The Carbon Storage Site Mapping Inquiry Tool and underlying database are valuable, intuitive resources that empower government, academic, commercial and industry stakeholders to explore, analyze, and acquire carbon storage related data.

Morkner, Paige↗