SEARCH · Engineering Papers

Results for “Workflow management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

All sources NASA NTRS DOE OSTI

NASA NTRS1992

Ground Systems Development Environment (GSDE) software configuration management

This report presents a review of the software configuration management (CM) plans developed for the Space Station Training Facility (SSTF) and the Space Station Control Center. The scope of the CM assessed in this report is the Systems Integration and Testing Phase of the Ground Systems development life cycle. This is the period following coding and unit test and preceding delivery to operational use. This report is one of a series from a study of the interfaces among the Ground Systems Development Environment (GSDE), the development systems for the SSTF and the SSCC, and the target systems for SSCC and SSTF. This is the last report in the series. The focus of this report is on the CM plans developed by the contractors for the Mission Systems Contract (MSC) and the Training Systems Contract (TSC). CM requirements are summarized and described in terms of operational software development. The software workflows proposed in the TSC and MSC plans are reviewed in this context, and evaluated against the CM requirements defined in earlier study reports. Recommendations are made to improve the effectiveness of CM while minimizing its impact on the developers.

Church, Victor E.↗

DOE OSTI2018

A View from ORNL: Scientific Data Research Opportunities in the Big Data Age

One of the core issues across computer and computational science today is adapting to, managing, and learning from the influx of "Big Data". In the commercial space, this problem has led to a huge investment in new technologies and capabilities that are well adapted to dealing with the sorts of human-generated logs, videos, texts, and other large-data artifacts that are processed and resulted in an explosion of useful platforms and languages (Hadoop, Spark, Pandas, etc.). However, translating this work from the enterprise space to the computational science and HPC community has proven somewhat difficult, in part because of some of the fundamental differences in type and scale of data and timescales surrounding its generation and use. We describe a forward-looking research and development plan which centers around the concept of making Input/Output (I/O) intelligent for users in the scientific community, whether they are accessing scalable storage or performing in situ workflow tasks. Much of our work is based on our experience with the Adaptable I/O System (ADIOS 1.X), and our next generation version of the software ADIOS 2.X [1].

Klasky, Scott↗

DOE OSTI2025

eDNAjoint: An R package for interpreting paired or semi‐paired environmental DNA and traditional survey data in a Bayesian framework

Abstract Environmental DNA (eDNA) sampling is increasingly used in surveys of species distribution as a potentially sensitive and efficient monitoring method. Yet access to modelling tools designed specifically for interpreting this new data type lags behind its ubiquity. While occupancy modelling software has dominated the analytical landscape for eDNA data analysis of single species, this type of model may not always be the most appropriate. The rate of eDNA detection often corresponds to species density, rather than just occupancy, and researchers often have access to observations from non‐genetic sampling methods at the same sites. To provide users access to a modelling framework designed to maximize the use of all available data, we developed an R package, eDNAjoint . The package provides an easy‐to‐use interface for fitting a ‘joint’ model that integrates data from paired or semi‐paired eDNA and traditional surveys in a Bayesian framework. The model can be used to estimate parameters like the probability of a false positive eDNA detection and mean catch rate at a site, and the package allows access to multiple model variations and Bayesian prior customization. Additional functionality can be used for model selection, summarising posteriors and comparing the relative sensitivities of the two survey methods. We demonstrate the use of eDNAjoint by fitting a variation of the model with site‐level covariates that scale the sensitivity of eDNA sampling relative to traditional sampling. The example workflow uses binary eDNA and seine count data for the endangered tidewater goby ( Eucyclogobius newberryi ) from a study by Schmelzle and Kinziger (2016). This use case includes a prior sensitivity analysis and an evaluation of the relationship between detection rates and environmental variables. eDNAjoint has the potential to greatly increase the range of users who will be able to rigorously analyse eDNA and traditional survey data in a Bayesian framework, understand if and how eDNA can improve monitoring practices, and gain confidence in the interpretability of eDNA data.

Keller, Abigail G. [Department of Environment Scie↗

DOE OSTI2020

Block Design with Common Reference Samples Enables Robust Large-Scale Label-Free Quantitative Proteome Profiling

Label-free quantitative proteomics has become an increasingly popular tool for profiling global protein abundances. However, one major weakness is the potential performance drift of the LC-MS platform over time, which in turn limits its utility for analyzing large-scale sample sets. To address this, in this work we introduce an experimental and data analysis scheme based on a block-design with common controls within each block for enabling LC-MS-based large-scale label-free quantification. In this scheme, a large number of samples (e.g., >100 samples) are analyzed in smaller, and more manageable blocks, minimizing instrument drift and variability within a block. Furthermore, each designated block also contains common controls (or reference) samples for normalization within and across blocks. We demonstrated the effectiveness of this method by profiling the proteome response of human macrophage THP-1 cells to 11 engineered nanomaterials (ENMs) at two different doses. A total of 116 samples were analyzed in six blocks, yielding an average coverage of 4500 proteins per sample. The data revealed consistent quantification of proteins across all six blocks, as shown by highly stable quantification of house-keeping proteins in all samples and high levels of quantification correlation among samples from different blocks. The data also demonstrated that label-free quantification is robust and accurate enough to quantify even very subtle abundance changes as well as large fold-changes without potential ratio compression as often encountered with isobaric labeling. Our streamlined workflow is easy to implement and can be readily adapted to other large cohort studies for reproducible label-free proteome quantification.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Robust Event Classification Using Imperfect Real-world PMU Data

Here, this paper studies robust event classification using imperfect real-world phasor measurement unit (PMU) data. By analyzing the real-world PMU data, we find it is challenging to directly use this dataset for event classifiers due to the low data quality observed in PMU measurements and event logs. To address these challenges, we develop a novel machine learning framework for training robust event classifiers, which consists of three main steps: data preprocessing, fine-grained event data extraction, and feature engineering. Specifically, the data preprocessing step addresses the data quality issues of PMU measurements (e.g., bad data and missing data); in the fine-grained event data extraction step, a model-free event detection method is developed to accurately localize the events from the inaccurate event timestamps in the event logs; and the feature engineering step constructs the event features based on the patterns of different event types, in order to improve the performance and the interpretability of the event classifiers. Based on the proposed framework, we develop a workflow for event classification using the real-world PMU data streaming into the system in real time. Using the proposed framework, robust event classifiers can be efficiently trained based on many off-the-shelf lightweight machine learning models. Numerical experiments using the real-world dataset from the Western Interconnection of the U.S power transmission grid show that the event classifiers trained under the proposed framework can achieve high classification accuracy while being robust against low-quality data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2024

3D high-fidelity automated neutronics guided optimization of fusion blanket designs

The compact Fusion Pilot Plant (FPP) is defined in the recent National Academies of Sciences, Engineering, and Medicine report as the next step of fusion energy demonstration with a $50$ MWe peak net electricity production, $Q_e$ greater than $1$, and at least $3$ hours of continuous operation. This fusion pilot plant will be a test bed enabling materials, designs, and fuel management assessment, and it will represent an engineering challenge because of its high-fusion power and compact design targets. Previous reactor data is limited to experiments operating in different design space ranges. Therefore, design iterations and assessments should rely on high-fidelity first-principle theoretical and computational models. The high-fidelity integrated modeling of the plasma is a fundamental part of fusion energy research. However, the whole device modeling is often neglected, utilizing low-fidelity, system-level analysis. Recently, the need for high-fidelity multi-physics modeling was recognized, resulting in a selection of integrated tools. Further, autonomous design optimization requires a streamlined framework that perturbs the design point, reruns the analysis, and examines the outputs. However, high-fidelity analysis requires complex geometry specification that is difficult to perturb. This work presents the parametric CAD generation tool TRACER and a new neutronic workflow. TRACER allows the perturbation of the geometry representation, creating geometry files ready for further analysis. The streamlined neutronic workflow allows efficient and accurate calculations. The two new tools coupled together were used to perform a 3D high-fidelity multi-objective, multi-input optimization of an "ARC Class" compact tokamak design. The workflow was driven by an optimization driver for full automation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRSDate not supplied

Addressing User Needs through the Stakeholder Engagement Program

Every two years, the Satellite Needs Working Group (SNWG), an initiative of the U.S. Group on Earth Observations (USGEO), surveys federal agencies to pinpoint their satellite Earth observation needs. For each expressed need, NASA-led assessment teams coordinate with the agencies to devise solutions. Solutions can include existing or modified data products as well as the construction of new data products and technologies, such as the Harmonized Landsat Sentinel-2 (HLS) product and the Catalog of Archived Sub-Orbital Earth Science Investigations (CASEI). To facilitate adoption of new data products and technologies, the SNWG Management Office’s Stakeholder Engagement Program (SEP) was established. The program’s primary goals are to respond to training and capacity building needs expressed by agencies and to encourage engagement from stakeholders as SNWG solutions are developed. To serve these needs, SEP has developed the following: an SNWG Solutions Earthdata webpage, an SEP Earthdata webpage, and an Earthdata Search Portal for SNWG products. These avenues provide assistance to users from all backgrounds and levels of expertise as well as publicize the ongoing efforts of SNWG solutions. In addition, the SEP is also collaborating with NASA’s Short-term Prediction Research and Transition (SPoRT) Center to develop user-driven applications for SNWG products leveraging stakeholder input. This presentation will provide an overview of the SEP, highlight the resources currently available to users, and describe ongoing efforts to address the needs of users, so SNWG products can be better implemented into scientific workflows.

Jenny Wood↗

NASA NTRS2023

Shoshone River Water Resources II: Quantifying Sediment Input in the Shoshone River in Wyoming using the Soil and Water Assessment Tool for Enhanced Water Quality Monitoring

The Willwood Dam, an irrigation diversion dam located on the Shoshone River (Wyoming, USA), has faced ongoing issues with sediment accumulation and needs frequent sediment flushing to remain operable. However, high suspended sediment levels during flushing events have negatively impacted downstream aquatic ecology and recreational opportunities. To address these problems, DEVELOP partnered with the Wyoming Department of Environmental Quality, Shoshone River Partners, and United States Geologic Survey. During term one, the team developed a workflow to map turbidity using PlanetScope imagery, analyze time series precipitation data, and create landcover maps. For this term, we focused on three methods to gain a better understanding of sediment sources: 1) improving remote sensing of turbidity, 2) modeling sediment transport within the watershed using the Soil and Water Assessment Tool (SWAT), and 3) conducting a snow cover time series analysis using Suomi NPP VIIRS imagery. Through remote sensing, we found Dry Creek/Homesteader Creek and Penney Gulch/Rough Gulch had the highest concentration sediment plumes. The SWAT+ model created a high-resolution grid model of the watershed, identifying high sedimentation in the western and southern subbasins but displayed low-correlated calibration and validation results due to limited observed data. We analyzed the snow cover extent alongside other hydrologic variables and found that snow melt events correlated with increases in suspended sediment concentration and turbidity values. Coupling remote sensing with hydrological modeling will give watershed managers a new perspective on high-priority regions for implementation of remediation to reduce the sediment build-up at the Willwood Dam.

Suspended Sediment↗

DOE OSTI2024

Description of FY25 Theory and Simulation Performance Target: Development of an integrated modeling framework for fusion reactor design and assessment

The urgency to deliver fusion power is growing now more than ever, with increasing pressure for both public programs and private companies to meet milestones timelines and overcome significant remaining technical challenges to ensure growth of a nascent fusion industry in time to meet rapidly growing clean energy demands. With incredible advancements in computation and years of investment in fusion model development and validation, integrated modeling is poised to fill a key role in accelerating the timeline to a fusion pilot plant (FPP). Future fusion pilot plants will operate in regimes far beyond current experience, and device design will rely on physics-based prediction and extrapolation. Many concepts will also rely on simulation to assess safety (shielding, tritium management, materials activation and lifetimes), economics and scalability before the decision to build. Importantly, integrated simulation can be used to reveal and solve the complexities of system integration that may otherwise not be apparent in physical components or models developed in isolation. New experimental test facilities that produce relevant conditions to validate and resolve key technical challenges for various subsystems (materials, blankets, fuel cycle, etc.) have been repeatedly called for by the fusion community but are not yet realized. Integrated modeling has an important role in identifying realistic load conditions (thermal, electromagnetic, plasma, neutron and photon loads, etc.) and defining the components and experiments for these test facilities in order to ensure meaningful validation that sufficiently reduces modeling uncertainties and technical risk for the full integrated reactor. The Fusion REactor Design and Assessment (FREDA) SciDAC project is building a component-based integrated modeling framework & data structure to enable self-consistent, multi-fidelity, iterative optimization workflows for the fusion reactor design process. FREDA aims to shorten the time to viable designs by providing a set of flexible workflows to support the various stages of the design process using an integrated model hierarchy, ranging from the simple analytic descriptions to the highest fidelity, theory-based plasma and engineering modeling developed by the fusion and fission communities. These tools are expected to be needed for timely support of FPP design in the milestone program and in the FIRE collaboratives. The plasma simulation backbone of FREDA is IPS-FASTRAN with newly developed coupled Core-Edge Pedestal-SOL (CESOL) workflows, which is being extended to the far-SOL region up to the plasma facing components. FREDA incorporates the FERMI engineering modeling suite and will enable self-consistent evaluation of the thermal shields, limiters, blanket, magnets, and other surrounding structures with predictions of temperatures, erosion, dpa, activation, tritium generation and transport, creep, corrosion, material degradation, etc. Parametric generation of 3D CAD enables rapid iteration of component geometry in response to plasma and loading specifications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

HybridSystemsSimulations.jl - Solving the Merchant Collocated Facilities with JuMP

The development of new clean-generation technologies also leads to new plant-level architectures that combine several generation and storage assets behind the point of connection. These co-located generation resources (Hybrid Systems) primarily operate as merchant assets that employ automated market bidding models and internal Energy Management Systems (EMS) to comply with the operator's signals. Formulating an optimal bidding model requires embedding the EMS control model into the bidding algorithm, resulting in a bi-level optimization problem. In this presentation, we first showcase using JuMP to formulate and solve this problem effectively for multiple merchant systems and the bidding outcomes considering different model formulations. Second, the bidding outcomes are later integrated into a PowerSimulations.jl (also built with JuMP) simulation to study the system-level effects of the various merchant bidding and the interactions between market-clearing models and the embedded EMS model. We will showcase simulations conducted in the RTS system considering different levels of merchant hybrid systems participation. The presentation provides the following specific insights on JuMP usage: 1) the Formulation of specialized bi-level problems with custom cuts to solve the merchant hybrid system bidding problem; 2) the integration of a modular model within a complex simulation workflow supported by JuMP in PowerSimulations.jl; 3) Accelerating the solution of power systems operations simulation that employ agent optimization problems using JuMP.

energy markets↗

DOE OSTI2017

Control and Information Systems for the National Ignition Facility

Orchestration of every National Ignition Facility (NIF) shot cycle is managed by the Integrated Computer Control System (ICCS), which uses a scalable software architecture running code on more than 1950 front-end processors, embedded controllers, and supervisory servers. The ICCS operates laser and industrial control hardware containing 66 000 control and monitor points to ensure that all of NIF’s laser beams arrive at the target within 30 ps of each other and are aligned to a pointing accuracy of less than 50 μm root-mean-square, while ensuring that a host of diagnostic instruments record data in a few billionths of a second. NIF’s automated control subsystems are built from a common object-oriented software framework that distributes the software across the computer network and achieves interoperation between different software languages and target architectures. A large suite of business and scientific software tools supports experimental planning, experimental setup, facility configuration, and post-shot analysis. Standard business services using open-source software, commercial workflow tools, and database and messaging technologies have been developed. An information technology infrastructure consisting of servers, network devices, and storage provides the foundation for these systems. Thus, this work is an overview of the control and information systems used to support a wide variety of experiments during the National Ignition Campaign.

42 ENGINEERING↗

DOE OSTI2023

Management and International Sorption Model Collaboration (M4SF-23LL010302062-NEA-TDB)

This progress report (Level 4 Milestone Number M4SF-23LL010302062) summarizes research conducted at Lawrence Livermore National Laboratory (LLNL) within the Crystalline International Collaborations Activity Number SF-23LL01030206. The activity is focused on our long-term commitment of engaging our partners in international nuclear waste repository research. This includes participation in the Nuclear Energy Agency Thermochemical Database (NEA-TDB) Project and development of methodologies for integrating US and international thermodynamic databases for use in SFWST Generic Disposal System Assessment (GDSA) efforts. A continuing focus for FY23 efforts has been to support the US participation in the NEA-TDB effort (Mavrik Zavarin replaced Cindy Atkins-Duffin on the NEA-TDB Management Board (MB) and Executive Group (EG)) and developing mechanisms for integration of NEA-TDB thermochemical data with LLNL’s SUPCRTNE thermodynamic database that supports the SFWST GDSA activities. This effort is coordinated with the Argillite work package SUPCRTNE database development efforts. The goal is to provide a downloadable database that will be hosted on a LLNL website which integrates NEA-TDB data into the LLNL SUPCRTNE database where appropriate. As part of our international activities, we continue our effort to integrate international sorption databases into L-SCIE (Zavarin et al., 2022b). We presented opportunities to include sorption in the next phase of NEA-TDB efforts at the April 2023 EG meeting in Paris. FY23 efforts focused on ensuring interoperable database development across multiple international database development activities. The overall goal is to produce an open source database that can be shared and integrated with multiple nuclear waste programs internationally and harness modern data science workflows and algorithms to incorporate these new approaches into reactive transport and performance assessment models. In collaboration with our Helmholtz Zentrum Dresden Rossendorf partners, we recently demonstrated the power of FAIR open source databases by fitting iron oxide (hydrous ferric oxide, goethite, hematite, and magnetite) protolysis constants to all available L-SCIE data. The results were submitted as a manuscript to J. Colloid Interface Science. This work will inform future metal sorption studies on a variety of iron oxides in order to discern the most appropriate acidity constants and surface complexation modeling constructs to account for pH-dependent mineral surface charge behavior. This work also explored automated surface complexation model development workflows in order to generate higher throughput model input files for a more facile incorporation into GDSA activities.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

DOE OSTI2015

WE-G-BRA-07: Analyzing the Safety Implications of a Brachytherapy Process Improvement Project Utilizing a Novel System-Theory-Based Hazard-Analysis Technique

Purpose: To investigate the hazards in cervical-cancer HDR brachytherapy using a novel hazard-analysis technique, System Theoretic Process Analysis (STPA). The applicability and benefit of STPA to the field of radiation oncology is demonstrated. Methods: We analyzed the tandem and ring HDR procedure through observations, discussions with physicists and physicians, and the use of a previously developed process map. Controllers and their respective control actions were identified and arranged into a hierarchical control model of the system, modeling the workflow from applicator insertion through initiating treatment delivery. We then used the STPA process to identify potentially unsafe control actions. Scenarios were then generated from the identified unsafe control actions and used to develop recommendations for system safety constraints. Results: 10 controllers were identified and included in the final model. From these controllers 32 potentially unsafe control actions were identified, leading to more than 120 potential accident scenarios, including both clinical errors (e.g., using outdated imaging studies for planning), and managerial-based incidents (e.g., unsafe equipment, budget, or staffing decisions). Constraints identified from those scenarios include common themes, such as the need for appropriate feedback to give the controllers an adequate mental model to maintain safe boundaries of operations. As an example, one finding was that the likelihood of the potential accident scenario of the applicator breaking during insertion might be reduced by establishing a feedback loop of equipment-usage metrics and equipment-failure reports to the management controller. Conclusion: The utility of STPA in analyzing system hazards in a clinical brachytherapy system was demonstrated. This technique, rooted in system theory, identified scenarios both technical/clinical and managerial in nature. These results suggest that STPA can be successfully used to analyze safety in brachytherapy and may prove to be an alternative to other hazard analysis techniques.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2021

Atmospheric Carbon and Transport – America (ACT-America) Data Sets: Description, Management, and Delivery

The ACT-America project is a NASA Earth Venture Suborbital-2 mission designed to study the transport and fluxes of greenhouse gases. The open and freely available ACT-America data sets provide airborne in situ measurements of atmospheric carbon dioxide, methane, trace gases, aerosols, clouds, and meteorological properties, airborne remote sensing measurements of aerosol backscatter, atmospheric boundary layer height and columnar content of atmospheric carbon dioxide, tower-based measurements, and modeled atmospheric mole fractions and regional carbon fluxes of greenhouse gases over the Central and Eastern United States. In this study, we conducted 121 research flights during five campaigns in four seasons during 2016–2019 over three regions of the US (Mid-Atlantic, Midwest and South) using two NASA research aircraft (B-200 and C-130). We performed three flight patterns (fair weather, frontal crossings, and OCO-2 underflights) and collected more than 1,140 h of airborne measurements via level-leg flights in the atmospheric boundary layer, lower, and upper free troposphere and vertical profiles spanning these altitudes. We also merged various airborne in situ measurements onto a common standard sampling interval, which brings coherence to the data, creates geolocated data products, and makes it much easier for the users to perform holistic analysis of the ACT-America data products. Here, we report on detailed information of data sets collected, the workflow for data sets including storage and processing of the quality controlled and quality assured harmonized observations, and their archival and formatting for users. Finally, we provide some important information on the dissemination of data products including metadata and highlights of applications of ACT-America data sets.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2017

A Scientific Data Provenance Harvester for Distributed Applications

Data provenance provides a way for scientists to observe how experimental data originates, conveys process history, and explains influential factors such as experimental rationale and associated environmental factors from system metrics measured at runtime. The US Department of Energy Office of Science Integrated end-to-end Performance Prediction and Diagnosis for Extreme Scientific Workflows (IPPD) project has developed a provenance harvester that is capable of collecting observations from file based evidence typically produced by distributed applications. To achieve this, file based evidence is extracted and transformed into an intermediate data format inspired in part by W3C CSV on the Web recommendations, called the Harvester Provenance Application Interface (HAPI) syntax. This syntax provides a general means to pre-stage provenance into messages that are both human readable and capable of being written to a provenance store, Provenance Environment (ProvEn). HAPI is being applied to harvest provenance from climate ensemble runs for Accelerated Climate Modeling for Energy (ACME) project funded under the U.S. Department of Energy’s Office of Biological and Environmental Research (BER) Earth System Modeling (ESM) program. ACME informally provides provenance in a native form through configuration files, directory structures, and log files that contain success/failure indicators, code traces, and performance measurements. Because of its generic format, HAPI is also being applied to harvest tabular job management provenance from Belle II DIRAC scheduler relational database tables as well as other scientific applications that log provenance related information.

Stephan, Eric G.↗

DOE OSTI2026

DIVA/DeviceEditor v6.1.2

DIVA is an end-to-end DNA design and construction management platform that streamlines how researchers design, build, and receive sequence-verified DNA constructs. Through a web-based BioCAD interface (DeviceEditor), researchers independently design DNA constructs and submit them to a centralized queue with a single action. Designs progress transparently through standardized states which allow researchers to track status and access finished constructs via a central DNA repository. Submitted designs are reviewed by dedicated staff for feasibility and optimization, reducing costly failures and improving downstream execution. Automated DNA assembly software optimizes construction strategies by reusing existing parts where possible and sourcing synthetic DNA only when needed. Standardized, sequence-agnostic assembly methods enable many independent constructs to be built in parallel using lab automation, dramatically increasing throughput. High-throughput next-generation sequencing is used to verify construct accuracy, with flexible platforms selected based on task requirements. Throughout the process, detailed success and failure data are captured and analyzed, enabling continuous improvement of assembly protocols. Compared to traditional, manual DNA construction workflows, DIVA offers higher scalability, transparency, reproducibility, and data-driven optimization.

Plahar, Hector [Lawrence Berkeley National Laborat↗

DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

DOE OSTI2016

Automated metadata, provenance cataloging and navigable interfaces: ensuring the usefulness of extreme-scale data

The MPO (Metadata, Provenance, Ontology) Project successfully addressed the goal of improving the usefulness and traceability of scientific data by building a system that could capture and display all steps in the process of creating, analyzing and disseminating that data. Throughout history, scientists have generated handwritten logbooks to keep track of data, their hypotheses, assumptions, experimental setup, and computational processes as well as reflections on observations and issues encountered. Over the last several decades, with the growth of personal computers, handheld devices, and the World Wide Web, the handwritten logbook has begun to be replaced by electronic logbooks. This transition has brought increased capability such as supporting multi-media, hypertext, and fast searching. However, content creation and metadata (a set of data that describes and gives information about other data) capturing has for the most part remained a manual activity just as it was with handwritten logbooks. This has led to a fragmentation of data, processing, and annotation that has only accelerated as scientific workflows continue to increase in complexity. From a scientific perspective, it is very important to be able to understand the lineage of any piece of data: who, what, when, how, and why. This is typically referred to as data provenance. The fragmentation discussed previously often means that data provenance is lost. As scientific workflows move to powerful computers and become more complex, the ability to track all of the steps involved in creating a piece of data become even more difficult. It was the goal of the MPO (Metadata, Provenance, Ontology) Project to create a system (the MPO System) that allows for automatic provenance and metadata capturing in such a way to allow easy searching and browsing. This goal needed to be accomplished in a general way so that it may be used across a broad range of scientific domains, yet allow the addition of vocabulary (Ontology) that is domain specific as is required for intelligent searching and browsing in the scientific context. Through the creation and deployment of the MPO system, the goals of the project were achieved. An enhanced metadata, provenance, and ontology storage system was created. This was combined with innovative methodologies for navigating and exploring these data using a web browser for both experimental and simulation-based scientific research. In addition, a system to allow scientists to instrument their existing workflows for automatic metadata and provenance is part of the MPO system. In that way, a scientist can continue to use their existing methodology yet easily document their work. Workflows and data provenance can be displayed either graphically or in an electronic notebook format and support advanced search features including via ontology. The MPO system was successfully used in both Climate and Magnetic Fusion Energy Research. The software for the MPO system is located at https://github.com/MPO-Group/MPO and is open source distributed under the Revised BSD License. A demonstration site of the MPO system is open to the public and is available at https://mpo.psfc.mit.edu/. A Docker container release of the command line client is available for public download using the command docker pull jcwright/mpo-cli at https://hub.docker.com/r/jcwright/mpo-cli.

97 MATHEMATICS AND COMPUTING↗