Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data competition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Microbial sensitivity to temperature and sulfate deposition modulates greenhouse gas emissions from peat soils

Abstract Peatlands are among the largest natural sources of atmospheric methane (CH 4 ) worldwide. Microbial processes play a key role in regulating CH 4 emissions from peatland ecosystems, yet the complex interplay between soil substrates and microbial communities in controlling CH 4 emissions as a function of global change remains unclear. Herein, we performed an integrated analysis of multi‐omics data sets to provide a comprehensive understanding of the molecular processes driving changes in greenhouse gas (GHG) emissions in peatland ecosystems with increasing temperature and sulfate deposition in a laboratory incubation study. We sought to first investigate how increasing temperatures (4, 21, and 35°C) impact soil microbiome–metabolome interactions; then explore the competition between methanogens and sulfate‐reducing bacteria (SRBs) with increasing sulfate concentrations at the optimum temperature for methanogenesis. Our results revealed that peat soil organic matter degradation, mediated by biotic and potentially abiotic processes, is the main driver of the increase in CO 2 production with temperature. In contrast, the decrease in CH 4 production at 35°C was linked to the absence of syntrophic communities and the potential inhibitory effect of phenols on methanogens. Elevated temperatures further induced the microbial communities to develop high growth yield and stress tolerator trait‐based strategies leading to a shift in their composition and function. On the other hand, SRBs were able to outcompete methanogens in the presence of non‐limiting sulfate concentrations at 21°C, thereby reducing CH 4 emissions. At higher sulfate concentrations, however, the prevalence of communities capable of producing sufficient low‐molecular‐weight carbon substrates for the coexistence of SRBs and methanogens was translated into elevated CH 4 emissions. The use of omics in this study enhanced our understanding of the structure and interactions among microbes with the abiotic components of the system that can be useful for mitigating GHG emissions from peatland ecosystems in the face of global change.

AminiTabrizi, Roya↗
DOE OSTI2020

Phosphorus alleviation of nitrogen‐suppressed methane sink in global grasslands

Abstract Grassland ecosystems account for more than 10% of the global CH 4 sink in soils. A 4‐year field experiment found that addition of P alone did not affect CH 4 uptake and experimental addition of N alone significantly suppressed CH 4 uptake, whereas concurrent N and P additions suppressed CH 4 uptake to a lesser degree. A meta‐analysis including 382 data points in global grasslands corroborated these findings. Global extrapolation with an empirical modelling approach estimated that contemporary N addition suppresses CH 4 sink in global grassland by 11.4% and concurrent N and P deposition alleviates this suppression to 5.8%. The P alleviation of N‐suppressed CH 4 sink is primarily attributed to substrate competition, defined as the competition between ammonium and CH 4 for the methane mono‐oxygenase enzyme. The N and P impacts on CH 4 uptake indicate that projected increases in N and P depositions might substantially affect CH 4 uptake and alter the global CH 4 cycle.

Zhang, Lihua↗
DOE OSTI2022

Linking remotely sensed ecosystem resilience with forest mortality across the continental United States

Episodes of forest mortality have been observed worldwide associated with climate change, impacting species composition and ecosystem services such as water resources and carbon sequestration. Yet our ability to predict forest mortality remains limited, especially across large scales. Time series of satellite imagery has been used to document ecosystem resilience globally, but it is not clear how well remotely sensed resilience can inform the prediction of forest mortality across continental, multi-biome scales. Here, we leverage forest inventories across the continental United States to systematically assess the potential of ecosystem resilience derived using different data sets and methods to predict forest mortality. Here we found high resilience was associated with low mortality in eastern forests but was associated with high mortality in western regions. The unexpected resilience–mortality relation in western United States may be due to several factors including plant trait acclimation, insect population dynamics, or resource competition. Overall, our results not only supported the opportunity to use remotely sensed ecosystem resilience to predict forest mortality but also highlighted that ecological factors may have crucial influences because they can reverse the sign of the resilience–mortality relationships.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Recommended conventions for reporting results from direct dark matter searches

Abstract The field of dark matter detection is a highly visible and highly competitive one. In this paper, we propose recommendations for presenting dark matter direct detection results particularly suited for weak-scale dark matter searches, although we believe the spirit of the recommendations can apply more broadly to searches for other dark matter candidates, such as very light dark matter or axions. To translate experimental data into a final published result, direct detection collaborations must make a series of choices in their analysis, ranging from how to model astrophysical parameters to how to make statistical inferences based on observed data. While many collaborations follow a standard set of recommendations in some areas, for example the expected flux of dark matter particles (to a large degree based on a paper from Lewin and Smith in 1995), in other areas, particularly in statistical inference, they have taken different approaches, often from result to result by the same collaboration. We set out a number of recommendations on how to apply the now commonly used Profile Likelihood Ratio method to direct detection data. In addition, updated recommendations for the Standard Halo Model astrophysical parameters and relevant neutrino fluxes are provided. The authors of this note include members of the DAMIC, DarkSide, DARWIN, DEAP, LZ, NEWS-G, PandaX, PICO, SBC, SENSEI, SuperCDMS, and XENON collaborations, and these collaborations provided input to the recommendations laid out here. Wide-spread adoption of these recommendations will make it easier to compare and combine future dark matter results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

From Neglect to Progress: Assessing Social Sustainability and Decent Work in the Tourism Sector

Measuring social sustainability performance involves assessing firms’ implementation of social goals, including working conditions, health and safety, employee relationships, diversity, human rights, community engagement, and philanthropy. The concept of social sustainability is closely linked to the notion of decent work, which emphasizes productive work opportunities with fair income, secure workplaces, personal development prospects, freedom of expression and association, and equal treatment for both genders. However, the tourism sector, known for its significant share of informal labor-intensive work, faces challenges that hinder the achievement of decent work, such as extended working hours, low wages, limited social protection, and gender discrimination. This study assesses the social sustainability of the Portuguese tourism industry. The study collected data from the “Quadros do Pessoal” statistical tables for the years 2010 to 2020 to analyze the performance of Portuguese firms in the tourism sector and compare them with one another and with the overall national performance. The study focused on indicators such as employment, wages, and work accidents. The findings reveal fluctuations in employment and remuneration within the tourism sector and high growth rates in the tourism sector compared to the national average. A persistent gender pay gap is identified, which emphasizes the need to address this issue within the tourism industry. Despite some limitations, such as the lack of comparable data on work quality globally, incomplete coverage of sustainability issues, and challenges in defining and measuring social sustainability indicators, the findings have implications for policy interventions to enhance social sustainability in the tourism industry. By prioritizing decent work, safe working conditions, and equitable pay practices, stakeholders can promote social sustainability, stakeholder relationships, and sustainable competitive advantage. Policymakers are urged to support these principles to ensure the long-term sustainability of the tourism industry and foster a more inclusive and equitable society. This study provides insights for Tourism Management, sustainable Human Resource Management, Development Studies, and organizational research, guiding industry stakeholders in promoting corporate social sustainability, firm survival, and economic growth.

Santos, Eleonora (ORCID:0000000346930804)↗
DOE OSTI2024

Development of the tangent linear and adjoint models of the global online chemical transport model MPAS-CO 2 v7.3

We describe the development of the tangent linear (TL) and adjoint models of the Model for Prediction Across Scales (MPAS)-CO 2 transport model, which is a global online chemical transport model developed upon the non-hydrostatic Model for Prediction Across Scales – Atmosphere (MPAS-A). The primary goal is to make the model system a valuable research tool for investigating atmospheric carbon transport and inverse modeling. First, we develop the TL code, encompassing all CO 2 transport processes within the MPAS-CO 2 forward model. Then, we construct the adjoint model using a combined strategy involving re-calculation and storage of the essential meteorological variables needed for CO 2 transport. This strategy allows the adjoint model to undertake a long-period integration with moderate memory demands. To ensure accuracy, the TL and adjoint models undergo vigorous verifications through a series of standard tests. The adjoint model, through backward-in-time integration, calculates the sensitivity of atmospheric CO 2 observations to surface CO 2 fluxes and the initial atmospheric CO 2 mixing ratio. To demonstrate the utility of the newly developed adjoint model, we conduct simulations for two types of atmospheric CO 2 observations, namely the tower-based in situ CO 2 mixing ratio and satellite-derived column-averaged CO 2 mixing ratio (X CO 2 ). A comparison between the sensitivity to surface flux calculated by the MPAS-CO 2 adjoint model with its counterpart from CarbonTracker–Lagrange (CT-L) reveals a spatial agreement but notable magnitude differences. These differences, particularly evident for X CO 2 , might be attributed to the two model systems' differences in the simulation configuration, spatial resolution, and treatment of vertical mixing processes. Moreover, this comparison highlights the substantial loss of information in the atmospheric CO 2 observations due to CT-L's spatial domain limitation. Furthermore, the adjoint sensitivity analysis demonstrates that the sensitivities to both surface flux and initial CO 2 conditions spread out throughout the entire Northern Hemisphere within a month. MPAS-CO 2 forward, TL, and adjoint models stand out for their calculation efficiency and variable-resolution capability, making them competitive in computational cost. In conclusion, the successful development of the MPAS-CO 2 TL and adjoint models, and their integration into the MPAS-CO 2 system, establish the possibility of using MPAS's unique features in atmospheric CO 2 transport sensitivity studies and in inverse modeling with advanced methods such as variational data assimilation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

MatRIS: Addressing the Challenges for Portability and Heterogeneity Using Tasking for Matrix Decomposition (Cholesky)

The ubiquitous in-node heterogeneity of HPC and cloud computing platforms makes software portability and performance optimization extremely challenging. Described here, the MatRIS multilevel math library abstraction framework employs tasking to alleviate these difficulties. MatRIS includes the IRIS task-based runtime on the bottom level and exposes different layers of abstraction to render algorithms architecturally agnostic. MatRIS ensures the decomposition and creation of tasks that represent the necessary encapsulation of the optimized kernels from both vendor and open-source math libraries. Once built, MatRIS can select different combinations of accelerators at runtime, making it portable even on diverse heterogeneous architectures. By leveraging the IRIS runtime’s features for managing heterogeneity, MatRIS deploys algorithms that remove the need to specify orchestration and data transfer. This study describes how the serial task abstraction of a tiled Cholesky factorization is made portable and scalable in the case of multi-device and multi-vendor heterogeneity on a node with NVIDIA and AMD GPUs by using MatRIS. First, we demonstrate that Cholesky in MatRIS provides multi-GPU scalability that offers competitive performance versus cuSolverMG. Then, we present the challenges and opportunities for heterogeneous execution.

Monil, M. A. H.↗
DOE OSTI2021

Uranium Oxide Synthetic Pathway Discernment through Unsupervised Morphological Analysis

We present a novel unsupervised machine learning method for quantitative representation of scanning electron micrographs and its applications and performance for nuclear forensic analysis of uranium ore concentrates. The method uses a vector quantizing variational autoencoder followed by a histogram operation to encode a micrograph into a single dimensional representation, called the latent vector. The method requires no extant labeling of the data and can be applied over large datasets of micrographs with minimal human interaction. The representations generated are broadly descriptive of each micrograph and the microstructure of the material imaged. In the case of uranium ore concentrate analysis, the representations were amenable to processing reagent and ore concentrate species classification with accuracy of 81:8%, which is competitive with state-of-the-art supervised networks. The representations were also used to classify previously unseen processing routes, were able to classify imaging parameters such as magnification (to 76:0% accuracy), were able to classify fine grained process parameters such as calcining temperature (to 74:4% accuracy), and their informatic properties indicate that they are generally descriptive of the image represented. This method can be applied across microstructure analysis fields to perform quantitative analysis without the need for labor intensive and possibly biased human analysis.

Scanning Electron Microscopy, Vector Quantizing Va↗
DOE OSTI2024

Species interactions amplify functional group responses to elevated CO 2 and N enrichment in a 24‐year grassland experiment

Abstract Plant functional groups (FGs) differ in their response to global changes, although species within those groups also vary in such responses. Both species and FG responses to global change are likely influenced by species interactions such as inter‐specific competition and facilitation, which are prevalent in species mixtures but not monocultures. As most studies focus on responses of plants growing in either monocultures or mixtures, but rarely both, it remains unclear how interspecific interactions in diverse ecological communities, especially among species in different FGs, modify FG responses to global changes. To address these issues, we leveraged data from a 16‐species, 24‐year perennial grassland experiment to examine plant FG biomass responses to atmospheric CO 2 , and N inputs at different planted diversity. FGs differed in their responses to N and CO 2 treatments in monocultures. Such differences were amplified in mixtures, where N enrichment strongly increased C3 grass success at ambient CO 2 and C4 grass success at elevated CO 2 . Legumes declined with N enrichment in mixtures at both CO 2 levels and increased with elevated CO 2 in the initial years of the experiment. Our results suggest that previous studies that considered responses to global changes in monocultures may underestimate biomass changes in diverse communities where interspecific interactions can amplify responses. Such effects of interspecific interactions on responses of FGs to global change may impact community composition over time and consequently influence ecosystem functions.

Mohanbabu, Neha↗
DOE OSTI2023

Toward extracting $$\gamma $$ from $$B\rightarrow DK$$ without binning

Abstract $$B^\pm \rightarrow DK^\pm $$ B ± → D K ± transitions are known to provide theoretically clean information about the CKM angle $$\gamma $$ γ , with the most precise available methods exploiting the cascade decay of the neutral D into CP self-conjugate states. Such analyses currently require binning in the D decay Dalitz plot, while a recently proposed method replaces this binning with the truncation of a Fourier series expansion. In this paper, we present a proof of principle of a novel alternative to these two methods, in which no approximations at the level of the data representation are required. In particular, our new strategy makes no assumptions about the amplitude and strong phase variation over the Dalitz plot. This comes at the cost of a degree of ambiguity in the choice of test statistic quantifying the compatibility of the data with a given value of $$\gamma $$ γ , with improved choices of test statistic yielding higher sensitivity. While our current proof-of-principle implementation does not demonstrate optimal sensitivity to $$\gamma $$ γ , its conceptually novel approach opens the door to new strategies for $$\gamma $$ γ extraction. More studies are required to see if these can be competitive with the existing methods.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

A framework for materials informatics education through workshops

The burgeoning field of materials informatics necessitates a focus on educating the next generation of materials scientists in the concepts of data science, artificial intelligence (AI), and machine learning (ML). In addition to incorporating these topics in undergraduate and graduate curricula, regular hands-on workshops present the most effective medium to initiate researchers to informatics and have them start applying the best AI/ML tools to their own research. With the help of the Materials Research Society (MRS), members of the MRS AI Staging Committee, and a dedicated team of instructors, we successfully conducted workshops covering the essential concepts of AI/ML as applied to materials data, at both the Spring and Fall Meetings in 2022, with plans to make this a regular feature in future meetings. Here, in this article, we discuss the importance of materials informatics education via the lens of these workshops, including details such as learning and implementing specific algorithms, the crucial nuts and bolts of ML, and using competitions to increase interest and participation.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Onboarding in a Virtual Environment

A need for a standardized Division 10000 onboarding program for virtual hires was identified by management to formalize the way employees and interns are onboarded and trained into Division 10000. This white paper provides effective short and long-term suggestions in the efforts of improving virtual onboarding. Data suggests that remote work is going to become the forefront of many industry practices, which indicates the need of a standardized virtual onboarding practices. With our research, gap assessments, benchmarking, and conducting interviews both internally and externally, we found that clarity, culture, and connection proved to be the strongest solutions in order to maintain Sandia’s competitive edge and sustain workers both remote and in-person.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Enabling Load Following Capability in the Transatomic Power MSR

This project is dedicated towards designing a fuel processing system that enables liquid-fueled molten salt reactors (MSR) to load follow by removing the dissolved xenon in the fuel salt. As one of the Gen-IV nuclear reactor concepts, the molten salt reactor receives increasing development interests in the recent years. One distinguishing feature of the liquid-fueled molten salt reactor is its improved ability to operate in a load-following mode by including the unique online fission product removal system. Load-following means that the reactor changes its power output based on the demand on the grid. Most of the current operating nuclear reactors have limited load-following ability and operate as the base load on the grid. Due to the rapid increase of solar energy, the requirement on load-following capacity is significantly increased because of the varying power output of the solar panels, yet the traditional load-following capacity is expected to decrease as the decarbonization of the grid continues. Therefore, the ability to perform load-following operation for the nuclear reactors will greatly enhance the resilience of the grid and make nuclear energy more economically competitive. This load-following feature is included in many commercial molten salt reactor designs, such as the designs by Transatomic Power, Terrestrial Energy, and Flibe Energy. Unfortunately, detailed analysis of the fuel processing system for commercial scale MSRs is still lacking, as well as how the fuel processing quantitively impacts the load-following operation. Moreover, experimental data for many of the underlying physics of fuel processing is limited. This project aims to pave the way for the fuel processing technology to advance to the commercial stage by performing combined experimental and simulation research. During the project period, four interconnected aspects of the development of the fuel processing system in liquid-fueled molten salt reactors are investigated. These aspects are the simulation and analysis of the fission product removal system, the fuel cycle simulation, the coupled reactor neutronics and thermal hydraulics transient simulation, and the gaseous fission product removal experiment. Multiphase CFD simulations are performed for components of the processing systems, and simplified air-water experiments are carried out to provide validation data. It is concluded that the CFD simulation can satisfactorily predict the system level performance of the components, and engineering models are constructed based on this success. Fuel cycle analysis is performed for two representative MSR design, the MSBR and the Transatomic Power MSR. Open-source code SaltProc is developed to incorporate the unique fuel processing system of the MSRs. It is concluded that the removal of xenon is essential for load-following operation in thermal spectrum MSR and Molten Salt Breeder Reactor. For the Transatomic Power MSR, the xenon poisoning effect is negligible due to its relatively fast neutron spectrum, though the overall fuel cycle economics still benefits from the removal of xenon. Coupled reactor neutronics and thermal hydraulics transient simulation is performed specifically for the Transatomic Power MSR. It is concluded that the reactor core design could perform power ramping fast enough to satisfy load-following operation. Combining the findings from each aspect, it is concluded that the load-following operation of a thermal neutron MSR is dependent upon the removal of xenon, which could be achieved for a commercial sized reactor using continuous inert gas sparging in a separate system with reasonable dimensions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Restoration Hydro: A Watershed Approach to Standard Modular New Hydropower

The objectives of FOA DE- FOA-0001836- “Standard Modular Hydropower” included designing a standardized, modular, and environmentally compatible hydropower schematic for implementation in greenfield sites that generate up to 10 MW of capacity. Utilizing funds competitively awarded under DOE’s Water Power Technologies Office, the Natel Energy team developed a concept for modular new stream reach (NSR) hydropower that incorporates multi species upstream and downstream fish passage, improved river channel connectivity, and recreational modules. The in-stream design of the collective modules minimized site specific design and maximized the opportunities for modularity. Financial data was also presented using actual costs from regional suppliers, with figures provided in 2022 dollars. While the project team did not address potential permitting process improvements, the site selection criteria did consider established barriers to hydropower development such as tribal and preserved lands, interconnection proximity, and endangered species to exclude or deprioritize. The project’s design schematic met the objectives of the FOA, and presented a unique solution that targets alluvial pockets as natural features for sustainable development. Natel’s concept also incorporated the company's fish-safe Restoration Hydro Turbine for safe downstream passage, while featuring a rock arch that integrates fish passage, water, recreation, and grade control modules (including sediment). Alignment with the Department of Energy Office of Energy Efficiency and Renewable Energy (EERE) “Innovative Design Concepts for Standard Modular Hydropower and Pumped-Storage Hydropower” Program: According to the Hydropower Vision (DOE, 2016), approximately 16 GW of hydropower growth is possible with the development of technology solutions that balance efficiency, economics, and environmental sustainability. The desired outcome of the SMH program is transformational innovation specifically in the site identification, conceptual, and detailed design phases of technology development lifecycles (DOE, 2018). In developing the SMH design schematic, the team aimed to address the opportunities outlined in the Vision through an inverted design philosophy; rather than singularly prioritizing efficiency and power production, the team focused on integrating hydropower with restoration of degraded streams to optimal ecosystem function and provision of exceptional recreation value as design criteria. To achieve this, Restoration Hydro incorporates the principles of nature-based engineering (WWAP, 2018) and biomimicry (Biomimicry NL.) to strategically deploy complementary combinations of permanent, semi-permanent, and ephemeral low-head structures - such as natural and engineered log jams - that harness geomorphological and hydrological processes at the landscape-scale. Primary applications of Restoration Hydro include: 1) restoration of degraded watersheds’ natural ecological function and enhancement of hydrological connectivity; and 2) creation of associated co-benefits to hydro production, including increased groundwater recharge, improved sediment transport and management, improved water security and water quality. Restoration Hydro projects build upon proven watershed restoration engineering techniques by integrating hydropower turbines into low-head structures using innovative and evolving civil works concepts that facilitate fish and sediment passage, and in some cases create additional revenue-generating recreational opportunities. Powering low-head structures creates a directly monetizable layer of economic value in the form of flexible, reliable, renewable energy on top of the already high-value water, environmental and recreational benefits of watershed and river restoration. The approach aims to create a virtuous, self-reinforcing cycle whereby Restoration Hydro projects support the scaling of ecosystem restoration activities, creating a water-energy-carbon multiplier effect that, through the principles of adaptive change management: 1) improves the resilience of landscapes and downstream population centers for changing hydrological cycles; 2) creates a reliable energy resource that facilitates the integration of intermittent renewable power sources into grids; and 3) supports climate change mitigation through grid decarbonization and enhanced ecosystem carbon capture and retention.

13 HYDRO ENERGY↗
DOE OSTI2021

Fuzzy Simplicial Networks: A Topology-Inspired Model to Improve Task Generalization in Few-shot Learning

Deep learning has shown great success in settings with massive amounts of data but has struggled when data is limited. Few-shot learning algorithms, which seek to address this limitation, are designed to generalize well to new tasks with limited data. Typically, models are evaluated on unseen classes and datasets that are defined by the same fundamental task as they are trained for (e.g. category membership). One can also ask how well a model can generalize to fundamentally different tasks within a fixed dataset (for example: moving from category membership to tasks that involve detecting object orientation or quantity). To formalize this kind of shift we define a notion of “independence of tasks” and identify three new sets of labels for established computer vision datasets that test a model's ability to generalize to tasks which draw on orthogonal attributes in the data. We use these datasets to investigate the failure modes of metric-based few-shot models. Based on our findings, we introduce a new few-shot model called Fuzzy Simplicial Networks (FSN) which leverages a construction from topology to more flexibly represent each class from limited data. In particular, FSN models can not only form multiple representations for a given class but can also begin to capture the low-dimensional structure which characterizes class manifolds in the encoded space of deep networks. We show that FSN outperforms state-of-the-art models on the challenging tasks we introduce in this paper while remaining competitive on standard few-shot benchmarks.

deep learning↗