Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Web Services”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Summer 2021 Internship Report

During this internship program, I was assigned with developing a Web application to robustify web resources referenced by links (URI-Rs) in PDFs. It was intended for use in LANL Research 2 Library systems such as RASSTI (Review and Approval System for Scientific and Technical Information), where users submit scholarly PDFs that may contain URI-Rs. For such PDFs, the application should, using Web Archives, create robust snapshots (i.e., Mementos) of the web resources referenced by URI-Rs, and notify this robustification to LANL Research Library systems. The Mementos were to be created using the Robust Links Service, and the notifications were to be sent using the Linked Data Notifications (LDN) Protocol.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

G2PDeep-v2: A Web-Based Deep-Learning Framework for Phenotype Prediction and Biomarker Discovery for All Organisms Using Multi-Omics Data

Multi-omics data offers rich insights into complex traits across organisms, yet integrating and analyzing these datasets for phenotype prediction and marker discovery remains challenging. Researchers need accessible tools that combine deep learning, hyperparameter optimization, visualization, and downstream analysis in a unified web platform. To address this, we developed G2PDeep-v2, a web-based platform powered by deep learning for phenotype prediction and marker discovery from multi-omics data across a wide range of organisms, including humans and plants. The server provides multiple services for researchers to create deep-learning models through an interactive interface and train these models using an automated hyperparameter tuning algorithm on high-performance computing resources. Users can visualize the results of phenotype and markers predictions and perform Gene Set Enrichment Analysis for the significant markers to provide insights into the molecular mechanisms underlying complex diseases, conditions and other biological phenotypes being studied.

59 BASIC BIOLOGICAL SCIENCES↗

Bloom Filter framework for Web Archives

The software provides a framework to build a fast look up layer that reflects the holdings of an archive or database and operates between search/discovery system and disk storage. The software utilizes Bloom filter (BF) data structure. The discovery service powered by the Bloom filter layer comes with a very high level of accuracy yet space-saving, since BF compresses data to fit into RAM.

Balakireva, Lyudmila↗

Aggregate attack surface management for network discovery of operational technology

Interconnectivity has become a substratum of technology as the benefits of data-driven functionality are being realized in nearly all industries. Increased connectivity of Operational Technology (OT) exacerbates cyber risks because Industrial Control Systems (ICS) are becoming exposed to the Internet. These exposures are often done inadvertently through misconfigurations as additional network devices come online. Attack surface management (ASM) platforms can be used to identify vulnerabilities by performing external network discovery over the Internet using web spiders. These web spiders enable big data analytics of Internet of Things (IoT) devices as identifiable information of Internet-exposed equipment are archived in searchable databases that are made publicly available. There are a multitude of ASM service providers on the market. Here, this study was conducted to evaluate several commonly known tools to determine the aggregate attack surface of control systems. Queries were crafted by targeting commonly known manufacturers and communication protocols found in OT networks. Identified devices were that categorized based on technology types. Each query was replicated between several tools to target identical ICS equipment. Findings in this paper suggested a significant variance in the exposures discovered by each tool, but unique contributions were identified for each tool when a merged attack surface was derived. Therefore, all tools should be used in aggregate.

97 MATHEMATICS AND COMPUTING↗

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration

We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications – AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique contribution to the DOE Integrated Research Infrastructure (IRI) landscape. By creating a flexible, API-driven data request service, we address a significant need for high-speed data streaming sources for the X-ray science data analysis community. With the combination of data request API, mutual authentication web security framework, job queue system, high-rate data buffer, and complementary nature to facility infrastructure, the LCLStreamer framework has prototyped and implemented several new paradigms critical for future generation experiments.

Rogers, David [ORNL] (ORCID:0000000251871768)↗

Using containers to speed up development, to run integration tests and to teach about distributed systems

GlideinWMS is a workload manager provisioning resources for many experiments including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we’ll talk about what differentiates workspaces from other containers. We’ll describe our base system composed of three containers. A one-node cluster including a compute element and a batch system. A GlideinWMS Factory controlling pilot jobs. And a scheduler and Frontend, to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop and we’ll share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we’ll talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system also when offline. They simplified the training and onboarding of new team members and Summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco↗

Using Containers to Speed Up Development, to Run Integration Tests and to Teach About Distributed Systems

GlideinWMS is a workload manager provisioning resources for many experiments, including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development, we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we will talk about what differentiates workspaces from other containers. We will describe our base system, composed of three containers: a one-node cluster including a compute element and a batch system, a GlideinWMS Factory controlling pilot jobs, and a scheduler and Frontend to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop, and we will share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we will talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system even when offline. They simplified the training and onboarding of new team members and summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗

Demonstrating Load-Shaping Capabilities of Cost Minimizing Heat Pump Water Heater Controls with Varying Price Profiles

Increased penetration of photovoltaics and electrification of traditionally gas appliances are exacerbating existing challenges in cost-effectively balancing electricity grid supply and demand. Decarbonization without incurring expensive transmission and distribution system capacity increases requires shifting building loads from peak demand times to peak renewable production times. Grid operators are evaluating new ways of encouraging load shifting, including using time-varying price structures to provide a financial incentive. If devices incorporate price-responsive controls, a price profile could be designed to yield a wide variety of load curves as needed to optimize grid functionality. Heat pump water heaters (HPWHs) are an ideal device for price-responsive controls because the storage tank enables them to optimize the timing of electricity consumption without impacting hot water delivery service. This paper presents work demonstrating how price-responsive controls for HPWHs can provide different load profiles, as needed to stabilize the grid, in response to different price profiles. HPWH manufacturers now include web API and CTA-2045 communication capabilities which enable sending load shaping control signals. Pilot studies and preliminary programs have utilized these capabilities with uniform control strategies to reduce 4-9 PM electricity consumption. However, no studies have developed flexible controls capable of both a) responding to constantly varying price profiles and b) customizing logic to match the needs of each HPWH. Berkeley Lab's CalFlexHub project is pioneering price-driven load flexibility by developing and deploying cost-minimizing controls utilizing setpoint setting signals for fleets of HPWHs in response to varying price profiles. Control development is based on simulations using the Flexible Heat Pump Water Heater Performance Predictor which captures the control decisions of a residential, integrated HPWH manufacturer’s on-board controller. The proposed cost-reducing controls respond to constantly changing price profiles, providing the ability to change the price profile to generate load curves as needed to maintain grid stability. Preliminary simulations studying the load shaping capabilities of price-responsive controls on a fleet of 60 HPWHs have demonstrated an average of a) 135.4% increases in load during low-price periods, b) >36.8% reductions in electricity peak-price period, and c) 6.2% electricity cost savings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Characterizing US Wholesale Electricity Markets

The purpose of this report is to provide analysts seeking to conduct technoeconomic analysis studies (TEA) on energy systems in US Wholesale electricity markets with a starting point. This document provides an overview of the primary markets related to electricity generation, namely capacity markets and ancillary services markets. The report provides a summary of each of these then provides details on these markets in the context of the seven wholesale electricity markets in the US. The document also summarizes key documents, web resources, and textbooks that will provide useful data and economic understanding for the analyst conducting the TEA studies.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

U.S.-China Clean Energy Research Center Building Energy Efficiency (CERC-BEE) Open-Source Retrofit Targeting Tool (CRADA FP00007338 Final Report)

To increase the cost-saving energy and carbon dioxide (CO 2 ) emissions reductions in buildings and portfolios at the scale and speed necessary to limit climate change, researchers at LBNL and Johnson Controls (JCI) developed the Building Efficiency Targeting Tool for Energy Retrofits (BETTER). BETTER is a software tool that consists of three components: (1) the BETTER analytical engine source code (which was developed with intellectual property provided by JCI under CRADA FP00007338); (2) the BETTER web application, developed by LBNL and McQuillen Interactive Pty. Ltd; and (3) the BETTER application programming interface (API), also developed by LBNL and McQuillen Interactive Pty. Ltd. BETTER enables building and portfolio owners, managers, and service providers worldwide to quickly, easily identify cost-saving energy efficiency retrofits in existing buildings and portfolios without expensive site visits or complex modeling. With minimal data input, the tool benchmarks a building’s electric and fossil energy usage against peers; quantifies energy, cost and greenhouse gas (GHG) emission reduction potentials at the building and portfolio levels; and recommends energy efficiency measures to decarbonize and electrify buildings and portfolios, targeting specific energy savings levels. No other tool so comprehensively analyzes buildings and portfolios with such ease. If fully implemented, it is estimated that BETTER could help reduce emissions equivalent to planting 1.3 billion trees globally by 2030. Moreover, an additional 50-75% of embodied GHG emissions could be avoided in each case where BETTER results in a building being retrofitted instead of demolished and replaced, providing substantial additional decarbonization benefits for the buildings sector. BETTER has garnered multiple awards and avid interest from investors. In 2020, it earned a R&D 100 Award for innovation and a LBNL Director’s Award for Technology Transfer. In 2021, BETTER was named an EarthX E-Capital Summit Climate Tech Prize semi-finalist

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DQL (Django Query Logger) [SWR-24-96]

The Django Query Logger (DQL) is a tool that allows developers of Django web applications to stream the raw database queries that are being executed in real-time from any Django application for review, profiling, filtering, formatting, and analysis. Reference herein to any specific commercial products, process, or service by trade name, trademark, manufacturer, or otherwise, does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or Alliance for Sustainable Energy, LLC. The views and opinions of authors expressed in the available or referenced documents do not necessarily state or reflect those of the United States Government or Alliance.

Swindler, Alexander↗

Building a framework to genetically characterize “feather spots” and understand demographic impacts of solar energy sites on migratory bird populations

The lack of data on the impact of utility-scale solar facilities on avian species and populations adds to the cost of siting and operation. As much as 32 percent of the avian biological material (feathers and carcasses) recovered from solar facilities remain unidentified, because they often take the form of “feather spots”. Feather spots are remains of impacted animals that can be separated into two broad categories: 1) those remains that may be visually identified to a species, or 2) those that cannot be visually identified to a species due to degradation from the environment and/or scavenger activity (listed as “unknown”). Even when feather spots can be identified to species, they cannot be visually assigned to particular breeding populations. In some cases, it is unknown whether multiple feather spots represent single or multiple individuals. This project’s objectives were to: 1. Use a developed, genetic-based technique to identify and determine the species, population of origin, and number of individuals found in feather spots recovered from solar facilities. 2. Implement collected data and resulting analyses to develop a publicly accessible web-based decision-making tool that can be used by the solar industry, regulators and other stakeholders to inform siting, mitigation, and conservation management efforts. 3. Establish a not-for-profit fee-for-service center at UCLA to ensure collection and identification of feather spots continue after the project period of performance. During the Project Period, we proposed to establish a pipeline for collecting, transporting, and storing of avian biological material collected at solar facilities and the collection and identification of feather spots to species and individual. We proposed the development of a genetic-based framework that would recover viable DNA from feather spots, amplify this DNA (i.e., make millions of copies of the original DNA), and use it to match the resulting sequences to a national database of known species of birds. The result would be the identification of feathers spots that were previously unidentified, and the incorporation of these samples into a larger database that included all samples recovered from solar facilities. The resulting report (below) details the result of this work and its alignment with proposed activities. We proposed the use of the data collected to assess the comparative risk to specific species or populations of species from solar facilities. For some species, we have already identified genomic markers of specific breeding populations and developed “genoscapes,” maps of unique genetic variation across the full breeding range of a species. We used these (previously and newly developed) genoscapes to probabilistically link a feather spot to the specific breeding populations from which it originated (assignment probabilities range from 75%-100% depending on species and population groups). For those species without genoscapes, we developed a vulnerability and susceptibility estimate that determines the relative local and regional risk to populations that are in geographic proximity to solar facilities, using citizen science data (Breeding Bird Survey (BBS) and eBird). These two feather spot processing pipelines (see Figure 1 below) provide quantitative estimates as to the numbers of individuals from a given population of origin that are affected by solar facilities, and ultimately can reduce costs to the consumer by reducing the industry costs associated with mitigation and siting strategies for future solar energy development.

14 SOLAR ENERGY↗

Field surveying data of low-cost networked flood sensors in southeast Texas

Floods are common natural disasters worldwide and pose substantial risks to life, property, food production, and natural resources. Effective measures for flood mitigation and warning are essential. Southeast Texas is still at significant risk of flooding, and Lamar University is assisting the region with asset management of a flood sensor network for flooding events. This network provides real-time water stage information. Lamar University developed a survey program to measure elevation and coordinates at each sensor site location to make this data more useful for flood monitoring and mapping. This paper overviews the measurement of the elevation and coordinates of 74 networked flood sensors and various flood stage thresholds at critical points that flood decision-makers can use for reference at each site. In the first phase of this program, these sensors were deployed throughout a 7-county region spanning nearly 6,000 square miles in Southeast Texas. The latitude and longitude of the sensors and their elevations were determined using survey-grade Global Navigation Satellite System (GNSS) technology. Various Continually Operating Reference Stations (CORS) were utilized for post-processing to achieve sub-inch resolution. The flood stage thresholds, water level sensors elevation, and the elevations and positions of other critical surrounding points are viewable to the public through two online repositories and a web-based sensor management dashboard. The data is used to aid with decisions related to road closures or modeling efforts by mitigation decision-makers, emergency managers, and the public, including the Texas Department of Transportation, Houston Transtar, the National Weather Service, and the Sabine River Authority of Texas (SRA).

54 ENVIRONMENTAL SCIENCES↗

Stochastic Continuous-time Flexibility Scheduling and Pricing in Wholesale Electricity Markets

Large-scale integration of intermittent renewable energy sources (RES) is calling for additional flexibility resources as well as more advanced modeling and optimization techniques to account for the increasing uncertainty and variability in power systems operation. As the RES integration gains momentum, the magnitude and frequency of their variations increase, which may trigger ramping scarcity events in real-time power systems operation. This necessitates revisiting the present definition of power systems flexibility and reserve services to reflect their robustness and adequacy towards sub-interval variations of the load and RES, as well as adjusting the operation models to accommodate the new reserve services. This project took a fundamental approach and aimed at developing continuous-time scheduling and pricing model that accurately models the continuous-time variations of load and RES and efficiently deploys the ramping capability of flexible resources to compensate the sources of variability and uncertainty in the market. In this regard, this project pursued the following goals: Developing stochastic multi-fidelity continuous-time optimization models for scheduling of energy storage (ES) systems and flexible loads in wholesale energy markets; Developing the theory and practices of continuous-time locational marginal pricing for valuating energy storage systems and flexible loads in wholesale energy markets; Developing function space solution approach to convert the proposed stochastic multi-fidelity continuous-time optimization models into tractable mixed-integer linear optimization models; and Defining flexibility reserve as a new type of reserve in markets that would enable ultimate participation of energy storage devices in provision of services to compensate the variability and uncertainty of RES in electricity markets. This project successfully completed all five major tasks defined in the SOPO, and produced 8 high-impact journal papers, 6 conference papers, 3 published U.S. patents, and one web-based software for continuous-time operation optimization of power systems. The application of the proposed flexibility reserve and the stochastic multi-fidelity continuous-time operation scheduling models would modify the forward commitment and schedule of generating units, ES devices and flexible loads, and would line up the resources in such a way that the composition of available resources is better prepared to respond to the sub-hourly variations of the load and renewable resources in real-time operation. Therefore, this project paves the way to sustainable, reliable, and economic integration of renewable energy resources in power system, supporting the progress towards reaching the national targets on energy independence. Even if the proposed models offers a radically different point of view as compared to existing models, it does not alter fundamentally the architecture of power systems operations, nor the complexity of the scheduling problem, so the integration of this project in power systems is extremely practical.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Smart manufacturing maturity models and their applicability: a review

The purpose of this paper is to review existing smart manufacturing (SM) maturity models' dimensions and maturity levels to assess their applicability and drawbacks. There are many maturity models available but many of them have not been validated or do not provide a useful guide or tool for applications. This gap creates the need for a review of the existing maturity model's applicability. Nineteen peer-reviewed maturity models related to “Digital Transformation,” “Industry 4.0” or “Smart Manufacturing” were selected based on a systematic literature review and five consulting firm models were selected based on the author's industry knowledge. The chosen models were analyzed to determine 10 categories of dimensions. Then they are assessed on a 1–5 scale for how applicable they are in the 10 categories of dimensions. The five “consulting firm” models have a first-mover advantage, are more widely used in industry and are more applicable, but some require payment, and they lack published details and validation. The 19 “peer reviewed” models are not as widely used, lack awareness in the industry and are not as easy to apply because of no web tool for self-assessment, but they are improving. The categories defined to characterize the models and facilitate comparisons for users include “Information Technology (IT) and Cyber-Physical System (CPS) and Data,” “Strategy and Organization,” “Supply Chain and Logistics,” “Products and Services,” “Culture and Employees,” “Technology and Capabilities,” “Customer and Market,” “Cybersecurity and Risk,” “Leadership and Management” and “Governance and Compliance.” The analyzed maturity models were particularly weak in the areas of cybersecurity, leadership and governance. Researchers and practitioners can use this review with consideration of their specific needs to determine if a maturity model is applicable or if a new model needs to be developed. The review can also aid in the development of maturity models through the discussion of each of the dimension categories. Finally, compared to existing reviews of SM maturity models, this research determines comprehensive dimension categories and focuses on applicability and drawbacks.

42 ENGINEERING↗

Support of US Burning Plasma Organization (Final Technical Report)

The objective of the project described here was to support and increase the effectiveness of the US Burning Plasma Organization. This a national organization of scientists and engineers in magnetic fusion energy, established in 2005 at the request of the DOE Office of Fusion Energy Sciences, which serves to “Advance the scientific understanding of burning plasmas and ensure the greatest benefit from a burning plasma experiment by coordinating relevant U.S. fusion research with broad community participation.” It has grown to over 420 members from over 70 institutions, primarily across the US but with some associate members from other countries. The project was divided into two tasks. The first supported leadership activities in the USBPO by the Deputy Director, Dr. Amanda Hubbard. Responsibilities included chairing regular meetings of the USBPO Research Committee, communicating with the USBPO membership via emails and web seminars, forming and overseeing activities of Task Groups, and ensuring good communication about activities of the International Tokamak Physics Activity. A task group report on ‘Recommendations for ITER Experimental Operation, U.S. Team Formation and Participation’ was completed. Hubbard organized a series of highly popular web seminars for the burning plasma community, on a range of topics attracting a large number of participants from diverse institutions. Hubbard ended her term as Deputy Director in May, 2020. She subsequently received the Secretary of Energy’s Appreciation award for her service to USBPO. The second task supported the communications functions of the USBPO, led by Communications Coordinator, Mark London. Communications are critical for the effective operation of the USBPO, given it consists of members at many widely scattered institutions, and conducts its business almost entirely using remote tools. MIT has hosted and maintained the USBPO website, mailing lists, and discussion forums and provided member support, and videoconferencing support. MIT has continued this support following this grant, with funding incorporated into a broader Cooperative Agreement.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

MEP: Mobility Energy Productivity Metric

In response to the need to assess fundamental improvements in mobility as technology provides new modes, methods, and opportunities in urban areas to connect people with goods, services, and employment, a mobility-energy productivity score (MEPS) has been developed. The MEPS fundamentally measures the potential of a multi-modal system to connect a person to a variety of services and activities that define a high-quality of life. The MEPS is measured relative to the convenience and energy needed to provide connectivity. Fundamentally derived from accessibility theory, the MEPS advances practice by using readily available travel time data (either from web-based APIs or outputs from an urban transportation model) combined with established parameters that reflect the energy intensity of various travel modes, and relative frequency of activity engagement. The construction of the MEPS allows for aggregation and disaggregation to the appropriate spatial, modal, and trip purpose resolution, as analysis needs dictate. The MEPS could be used to compare alternative futures related to technology, infrastructure investment, or policy, providing a much needed tool for planners, researchers, and analysts. In other words, the metric measures how efficiently connected a place is.

Hou, Yi↗

A Strategic Condition Framework for Energy Innovation

Building upon previous work in innovation, technology, and economic fields, we propose a conceptual framework to address the interplay dynamics of public policy and the value chains of clean energy technology innovation systems, by focusing on market structural and strategic conditions in relation to the rate and direction of knowledge diffusion within activity-based value chains. Our framework extends beyond socio-technical transition models by considering such nuances as: 1) the implications of geography, 2) the locus of knowledge types, 3) the dynamics of financial and knowledge flow, and 4) emphasizing the importance of both market structure and institutional conditions. At the firm level, we consider dynamics of interactions between suppliers and customers, innovation activities, the competitive environment, and the firm’s broader strategic relationship to governance activities and structures; we allow for the fact that each of these aspects of a firm’s identity may have a strategically relevant geographic dimension (e.g., service territories, locational concentration of input resources, etc.). We provide a proof-of-concept application of the U.S. utility-scale solar photovoltaic (PV) and onshore wind sectors, including their interactions with the U.S. power market, which we in present in a web-based information platform (Energy I-SPARK, ei-spark.lbl.gov).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗