Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “field deployment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43

Floating solar panels on reservoirs impact phytoplankton populations: A modelling experiment

Floating solar photovoltaic (FPV) deployments are increasing globally as the switch to renewable energy intensifies, representing a considerable water surface transformation. FPV installations can potentially impact aquatic ecosystem function, either positively or negatively. However, these impacts are poorly resolved given the challenges of collecting empirical data for field or modelling experiments. In particular, there is limited evidence on the response of phytoplankton to changes in water body thermal dynamics and light climate with FPV. Given the importance of understanding phytoplankton biomass and species composition for managing ecosystem services, we use an uncertainty estimation approach to simulate the effect of FPV coverage and array siting location on a UK reservoir. FPV coverage was modified in 10% increments from a baseline with 0% coverage to 100% coverage for three different FPV array siting locations based on reservoir circulation patterns. Results showed that FPV coverage significantly impacted thermal properties, resulting in highly variable impacts on phytoplankton biomass and species composition. The impacts on phytoplankton were often dependent on array siting location as well as surface coverage. Changes to phytoplankton species composition were offset by the decrease in phytoplankton biomass associated with increasing FPV coverage. We identified that similar phytoplankton biomass reductions could be achieved with less FPV coverage by deploying the FPV array on the water body's faster-flowing area than the central or slower flowing areas. The difference in response dependent on siting location could be used to tailor phytoplankton management in water bodies. Simulation of water body-FPV interactions efficiently using an uncertainty approach is an essential tool to rapidly develop understanding and ultimately inform FPV developers and water body managers looking to minimise negative impacts and maximise co-benefits.

14 SOLAR ENERGY↗

Field Validation of Dynamic Mechanical Torque Measurements for Geared Wind Turbines

Accurate knowledge of the mechanical loads of wind turbine gearboxes has become essential in modern, highly loaded gearbox designs, as maintaining or even improving gearbox reliability with increasing torque density demands is proving to be challenging. Unfortunately, the traditional method of measuring dynamic mechanical torque using strain gauges placed on the outer surface of a rotating shaft and transmitting the resulting signal is unsuitable for serial deployment due to technical and economic constraints. An alternative method based on fiber-optic strain sensors placed on the stationary outer surface of the gearbox ring gear has been proposed. Like shaft torsion, the radial deformation of the ring gear is proportionate to the rotor torque. Placing the sensors on a stationary component is a cost-effective alternative for serial implementation because the need for complex and expensive data transfer via wireless transmission or a slip ring is eliminated. In this paper, we present the results of an extensive field experiment conducted to evaluate the torque measurement accuracy of this novel sensing solution installed on the gearbox of a Gamesa G97 2-MW wind turbine at the National Renewable Energy Laboratory's Flatirons Campus. Torque measurements derived from fiber-optic strain sensors placed on the ring gear of the planetary stage are compared to conventional torque measurements from strain gauges placed on the main shaft. Two different torque estimation data processing methods were evaluated, with the method based on operational deflection shapes providing the most accurate results with an average normalized root mean square error below 0.7% for a load revolution distribution analysis. The effect of operating conditions on the torque estimate was also investigated, and the third planet-passing operational deflection shape was found to be the least sensitive to nontorque load-related effects. The fiber-optic strain sensors' successful operation during the complete test campaign has demonstrated a robust and accurate solution for fleet-wide enhanced gearbox remaining useful life estimation.

17 WIND ENERGY↗

Real Time and Forecasted DLR: Use Cases

This document contains two use cases for the utilization of dynamic line ratings in operational practices. These use cases were developed in support of the Transmission Optimization and Grid Enhancing Technology (TOGETS) task force aimed at facilitating the deployment of dynamic line rating and power flow technologies across the United States. The project included a demonstration of the technology on the Idaho National Laboratory system. The procurement documents, tests scripts, and field-validated results from multiple vendors will be published to improve industry’s familiarity with the products. Because of the urgency in performing this work and INL’s unique test setup, the Task Force identified a need for additional public information on the information exchanges required for operationalizing DLR (i.e. integrating DLR’s within actual system operations). As such, this use case document and an accompanying interoperability profile have been developed with input from the Task Force and various vendors whose systems would ultimately support the functionality described. The use case and interoperability profile support two distinct functionalities with different purposes.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Potential Risks Associated with Short-Term Hydrogen Storage in Methane Reservoirs

Hydrogen (H2) has been identified as a flexible energy carrier with zero emissions. It is possible to utilize H2 by storing Hyblend, or H2 blended with CH4, in existing natural gas infrastructure. However, the compatibility of adapting the current CH4 storage strategies to include H2 injection has not been fully demonstrated. It is essential that we understand the impact of H2 gas on the naturally occurring microbial community of subsurface storage reservoirs before deploying large-scale H2-CH4 storage. We designed a series of experiments that allowed us to identify potential challenges of HyBlend Storage in existing methane reservoirs (Figure 1). First, we characterized two field fluid samples from a methane reservoir located in Western United States. Next, we used these samples to complete a series of short-term reactor experiments at reservoir conditions for a natural gas (100% CH4) and HyBlend (80% CH4/20% H2) storage environment.

geomicrobiology↗

Automated segmentation of porous thermal spray material CT scans with predictive uncertainty estimation

Abstract Thermal sprayed metal coatings are used in many industrial applications, and characterizing the structure and performance of these materials is vital to understanding their behavior in the field. X-ray computed tomography (CT) enables volumetric, nondestructive imaging of these materials, but precise segmentation of this grayscale image data into discrete material phases is necessary to calculate quantities of interest related to material structure. In this work, we present a methodology to automate the CT segmentation process as well as quantify uncertainty in segmentations via deep learning. Neural networks (NNs) have been shown to excel at segmentation tasks; however, memory constraints, class imbalance, and lack of sufficient training data often prohibit their deployment in high resolution volumetric domains. Our 3D convolutional NN implementation mitigates these challenges and accurately segments full resolution CT scans of thermal sprayed materials with maps of uncertainty that conservatively bound the predicted geometry. These bounds are propagated through calculations of material properties such as porosity that may provide an understanding of anticipated behavior in the field.

Martinez, Carianne↗

EPCAPE Field: Final Campaign Report

The focus of the Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) was to characterize the extent, radiative properties, aerosol interactions, and precipitation characteristics of stratocumulus clouds in the Eastern Pacific across all four seasons at a coastal location. DOE ARM AMF1 with AOS was successfully deployed from February 14, 2023, through February 14, 2024, in La Jolla, California, at Scripps Pier and Mt. Soledad.

54 ENVIRONMENTAL SCIENCES↗

Field validation of isotropic analytical models for simulating fabric shades

Fabric roller shades are common shading materials used in commercial and residential buildings. Accurately characterizing and modeling shades helps practitioners select the appropriate product and its control strategy based on climate and occupants' priorities, such as visual comfort and view to outdoors. Previous studies established a generalized method for modeling complex fenestration systems using data-driven tabulated bidirectional scattering distribution functions. However, deploying such a method at scale to all fabric shading products on the market is too costly and time-consuming. Analytical models that are based on a limited set of measurements (e.g., normal-normal and normal-hemispherical visible transmittance and reflectance, and directional cut-off angles) can be used to model the wide variety of shading products on the market. This study evaluates the performance of two isotropic analytical models, Roos-Wienold and Modified-Kotey, for modeling fabric roller shades, with a focus on the model's ability to predict occupant visual comfort. The performance evaluation was conducted through laboratory and field measurements and simulations. The results showed that both models are sufficient for predicting vertical illuminance at seated eye-level. Roos-Wienold model was able to predict binary visual comfort classification (glare/no-glare) under a wide range of luminance conditions, while Modified-Kotey model did not perform as well under high-contrast low-adaptation conditions. Both models are insufficient in predicting visual comfort at a four-point scale (e.g., imperceptible, perceptible, disturbing, intolerable). The two isotropic models become less accurate when the fabric exhibits high anisotropy.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluation of Physical Microphysical Property Retrieval Algorithms During the 2020 IMPACTS Field Campaign

The NASA Investigation of Microphysics and Precipitation for Atlantic Coast Threatening Snowstorms (IMPACTS) field campaign provides high-quality, high-altitude aircraft lidar (532 nm), radar (W-band) and in-cloud microphysical aircraft data taken during wintertime storm events impacting the United States. This study evaluates two mass-dimensional relationships (Brown and Francis (1995, BF95); Heymsfield (2014, H14) and two lidar-radar microphysical retrieval algorithms (Cloudsat and CALIPSO Ice Cloud Property Product (2C-ICE); VarPy (a variational method derived from the satellite lidar-radar data community)) to estimate aircraft-retrieved volume extinction coefficient (σ), ice water content (IWC), and effective radius (r e ) during the 2020 IMPACTS deployment. BF95 and H14 have a close 1:1 correlation (R 2 = 0.98) with in-situ observations of σ. However, only BF95 displays a linear, consistent, and almost temperature-independent low bias for IWC and r e , which likely arises from the environmental conditions used to determine each. Unlike the field-campaign-derived BF95 and H14 relationships, VarPy and 2C-ICE directly ingest the aircraft-based lidar and radar data to simulate σ, IWC, and r e . For all three microphysical parameters, VarPy and 2C-ICE retrieval errors became notably more pronounced around the dendritic growth zone (-15°C to -10°C) and near freezing (≥-5°C), which suggests that both algorithms experience difficulty addressing riming and aggregation processes and with larger particles (dendrites and plates) due in part to their simplified ice particle assumptions. However, the mean-melt diameter ice-particle assumption did yield more accurate IWC estimates, which led to slightly better overall results for VarPy.

54 ENVIRONMENTAL SCIENCES↗

Study of Additive Manufacturing Application to Geothermal Technologies

Geothermal reservoir characterization, field construction, and reservoir operations are very technology intensive activities that contribute significantly to the cost of delivering electricity produced from geothermal resources. Many geothermal technologies, such as downhole tools and drilling equipment, have unusual material, design, and manufacturing considerations dictated by the harsh geothermal environment and extreme aspect ratios required for deployment in a borehole. An additional challenge that faces geothermal applications is the low tool production volume needed to support the industry. Whereas tens of thousands of Oil & Gas wells are drilled and completed in the U.S. annually, there are typically only tens of geothermal wells that are drilled and completed. If a tool typically used in Oil & Gas applications cannot be directly used for geothermal, then the cost associated with making the tool suitable for geothermal is often prohibitive. There is therefore a much smaller inventory of technologies available to geothermal as compared to Oil & Gas and the level of efficiency and sophistication associated with field practice suffers accordingly. A number of advanced manufacturing methods, such as additive manufacturing, have received increased R&D as well as commercial attention in recent years because of their ability to rapidly prototype complex parts. Additive manufacturing in particular provides an opportunity to increase the technology available to the geothermal industry by either reducing fabrication costs associated with complex components or enabling economic production of low volume parts where specialized tooling is often required. Additional potential benefits of additive manufacturing include increased design freedom to make higher performing parts that cannot be made conventionally, the ability to integrate components into assemblies without joining operations, and the ability to economically fabricate variations on design in cases, such as casting molds, where there are large up-front costs associated with tooling. We have recently completed a study that investigated technology needs, representative use cases, manufacturability, and a techno-economic framework for comparing conventional to additive manufacturing methods for geothermal applications. This paper will provide an overview of this recent effort, describe the different elements of the assessment, and summarize the key takeaways related to both the feasibility of using additive manufacturing for geothermal technology applications as well as the potential benefits and impacts.

Polsky, Yarom↗

Considerations regarding the Use of Computer Vision Machine Learning in Safety-Related or Risk-Significant Applications in Nuclear Power Plants

With the advancements made to date in the field of artificial intelligence (AI), significant potential exists to utilize AI capabilities for nuclear power plant (NPP) applications. AI can replicate human decision making and it is usually faster and more accurate than humans. For implementations that impact critical NPP applications (e.g., safety-related or non-safety systems that potentially affect overall plant risk), a deeper safety analysis of the AI methods is necessary. AI applied to NPP operations could resemble the use of digital I&C (DI&C) because such applications involve digital computer hardware and custom-designed software that input plant data, execute complex software algorithms, and output the results to a system or licensed human operator to potentially provoke an action. For AI methods to be compliant with current safety requirements for DI&C, AI compatibility must be evaluated, and AI-related gaps may exist that prevent the prompt deployment of AI in NPPs. This effort aims to evaluate how example AI technologies align with the DI&C safety framework, and discusses how they could be analyzed, modeled, tested, and validated in a manner similar to typical DI&C technologies. Because AI is a broad field that encompasses areas such as machine learning (ML), natural language processing, and computer vision, this research focused on a subset of methods categorized as the computer vision ML (CVML) methods. This report explores two CVML use cases, gauge reading and fire watch, considered relevant to the DI&C standards, as they could play a safety-critical role. For the gauge reading use case, a CVML-enabled technology that can read gauges at oblique angles is utilized. For the fire watch use case, a CVML-enabled technology is utilized that migrates fire watch from a manual (human) approach to automated fire detection. These use cases are mainly intended to give context to the CVML system discussion. This effort assumes the worst-case scenario, with the CVML system being used to replace a safety-related or risk-significant system, thus requiring evaluation. Evaluating CVML against most of the relevant safety requirements for DI&C yielded several CVML-specific considerations due to the uniqueness of its characteristics in comparison with typical DI&C systems. For example, CVML models often employ commonly used (open-source) datasets, and it is not always possible to determine the level of overlap among open-source datasets. Therefore, the independence of the developed CVML models when demonstrating diversity is questionable, therefore creating vulnerability to common cause failure (CCF). The design verification process is also impacted since the data overlap could result in overestimation of the software validation and verification (V&V) performance results. Section 2 of this report evaluates a list of the identified CVML-specific characteristics and discusses the resulting considerations and potential solutions in the context of each referenced requirement. A summation is provided in Section 3. This report is not to be used as a guideline. It was developed to identify and consider issues in the implementation of ML technologies used to augment activities that may have a bearing on plant operation. The report draws parallels to the use of DI&C technologies, for which many standards are available to guide their use in nuclear plant operation. It considers the technologies and some of the potential implications of their use in safety-related applications but is not intended to address regulatory or licensing related issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The case for digital twins in metal additive manufacturing

The digital twin (DT) is a relatively new concept that is finding increased acceptance in industry. A DT is generally considered as comprising a physical entity, its virtual replica, and two-way digital data communications in-between. Its primary purpose is to leverage the process intelligence captured within digital models—or usually their faster-solving surrogates—towards generating increased value from the physical entities. The surrogate models are created using machine learning based on data obtained from the field, experiments and digital models, which may be physics-based or statistics-based. Anomaly detection and correction, and diagnostic closed-loop process control are examples of how a process DT can be deployed. In the manufacturing industry, its use can achieve improvements in product quality and process productivity. Metal additive manufacturing (AM) stands to gain tremendously from the use of DTs. This is because the AM process is inherently chaotic, resulting in poor repeatability. However, a DT acting in a supervisory role can inject certainty into the process by actively keeping it within bounds through real-time control commands. Closed-loop feedforward control is achieved by observing the process through sensors that monitor critical parameters and, if there are any deviations from their respective optimal ranges, suitable corrective actions are triggered. The type of corrective action (e.g. a change in laser power or a modification to the scanning speed) and its magnitude are determined by interrogating the surrogate models. Because of their artificial intelligence (AI)-endowed predictive capabilities, which allow them to foresee a future state of the physical twin (e.g. the AM process), DTs proactively take context-sensitive preventative steps, whereas traditional closed-loop feedback control is usually reactive. Apart from assisting a build process in real-time, a DT can help with planning the build of a part by pinpointing the optimum processing window relevant to the desired outcome. Again, the surrogate models are consulted to obtain the required information. In this article, we explain how the application of DTs to the metal AM process can significantly widen its application space by making the process more repeatable (through quality assurance) and cheaper (by getting builds right the first time).

36 MATERIALS SCIENCE↗

SPRUCE FT-ICR MS, Bulk Chemistry, and Mass Loss from Litter Decomposition Study in Experimental Plots, Marcell Experimental Forest, Minnesota, 2015-2017

This dataset contains molecular, bulk chemical, and mass loss measurements from a litter decomposition study at the Spruce and Peatland Responses Under Changing Environments (SPRUCE) experimental site within the Marcell Experimental Forest in northern Minnesota, USA. This site is in a Sphagnum spp. ombrotrophic bog forest. Litterbags were deployed into the peat in September 2015 across three warming levels (+0, +4.5, and +9°C) under ambient and elevated carbon dioxide (CO₂ - +500 ppm) and retrieved after roughly 0.5, 1, and 2 years of field incubation (2015-09-23 to 2017-08-02). Litterbags containing six peatland litter types: black spruce needles (Picea mariana - SPL), spruce fine roots (SPR), Sphagnum angustifolium (ANG), Sphagnum magellanicum (MAG), Labrador tea leaves (Rhododendron groenlandicum - LTL), and Labrador tea roots (LTR). Molecular composition of water-soluble organic matter extracts was characterized using Fourier Transform Ion Cyclotron Resonance Mass Spectrometry (FT-ICR MS) at 9.4 Tesla, operated in negative ion mode with electrospray ionization, providing molecular formula assignments and compound-class distributions across the decomposition time series. Bulk chemical characterization included elemental analysis (percent carbon, nitrogen, and phosphorus) and Fourier Transform Infrared Spectroscopy (FTIR) to quantify functional group composition. Litter mass loss was tracked gravimetrically at each retrieval interval, expressed as percent mass remaining relative to initial dry mass for each litter type and treatment combination. These data are valuable for understanding how vegetation shifts driven by increased atmospheric CO2 and temperature in peatlands alter litter inputs and organic matter stabilization trajectories, with implications for projecting and modeling peatland carbon cycling. This dataset contains two data files in comma-separated value (.csv) format. Additional metadata are provided: two data dictionaries and a file-level metadata file in comma separate (.csv) format and a user guide in PDF (*.pdf) format.

decomposition↗

Cross Validation of the Network of Ground-Based Radar with GPM during the Remote Sensing of Electrification, Lightning, And Mesoscale/Microscale Processes with Adaptive Ground Observations (RELAMPAGO) Field Campaign

The cross-validation of radars in a network is important in making consistent retrievals across the domain and assuring the product quality. During the RELAMPAGO field campaign, two C-band radars, namely the Colorado State University C-band Hydrological Instrument for Volumetric Observations ( CSU-CHIVO) and the C-band Scanning ARM Precipitation Radar (CSAPR-2), were deployed near the Sierras de Cordoba in Argentina, a region known for having some of the most intense severe weather in the world. In addition to these two radars, the operational radar of the Cordoba City, the Radar Meteorologico Argentino 1 (RMA-1), adds another instrument to the RELAMPAGO network. This study presents an intercomparison between the RELAMPAGO C-band radars using the GPM spaceborne radar as a common reference ..A method to bring ground-based radars into better agreement is also proposed. Moreover, the attenuation correction for the C-band radar is studied in the context of intercomparing two radars. The attenuation coefficients are computed for the RELAMPAGO domain using the local disdrometers deployed. during the campaign. After the attenuation correction, CSU-CHIVO, CSAPR-2, and RMA-1 compare well with GPM-DPR with a high correlation and bias less than 1 dB.

54 ENVIRONMENTAL SCIENCES↗

Atmospheric Boundary Layer-Wind Farm Interactions Field Campaign Report

The American WAKE ExperimeNt (AWAKEN) was a field campaign in northern Oklahoma intended to analyze the potential influence of wind farms and their collective wakes on the atmospheric boundary layer (ABL), wind power production, and turbine structural loads. This report summarizes the deployment of instruments by the University of Oklahoma (OU), National Atmospheric and Atmospheric Administration National Severe Storms Laboratory (NOAA NSSL), and Lawrence Livermore National Laboratory (LLNL) during AWAKEN. Two Collaborative Lower Atmosphere Profiling Systems (CLAMPS) and LLNL ZephIR profiling lidars were co-deployed from October 3, 2022, to December 20, 2022 (winter campaign). At the end of the winter campaign, both ZephIR lidars were moved to different AWAKEN sites to be a part of a targeted wake study at the King Plains wind farm. The two CLAMPS were redeployed for a second observation period from July 1st, 2023, to September 28, 2023 (summer campaign; the ZephIR lidars were not co-located with CLAMPS).

54 ENVIRONMENTAL SCIENCES↗

Research Trends and Applications of PMUs

This work is a survey of current trends in applications of PMUs. PMUs have the potential to solve major problems in the areas of power system estimation, protection, and stability. A variety of methods are being used for these purposes, including statistical techniques, mathematical transformations, probability, and AI. The results produced by the techniques reviewed in this work are promising, but there is work to be performed in the context of implementation and standardization. As the smart grid initiative continues to advance, the number of intelligent devices monitoring the power grid continues to increase. PMUs are at the center of this initiative, and as a result, each year more PMUs are deployed across the grid. Since their introduction, myriad solutions based on PMU-technology have been suggested. The high sampling rates and synchronized measurements provided by PMUs are expected to drive significant advancements across multiple fields, such as the protection, estimation, and control of the power grid. This work offers a review of contemporary research trends and applications of PMU technology. Most solutions presented in this work were published in the last five years, and techniques showing potential for significant impact are highlighted in greater detail. Being a relatively new technology, there are several issues that must be addressed before PMU-based solutions can be successfully implemented. This survey found that key areas where improvements are needed include the establishment of PMU-observability, data processing algorithms, the handling of heterogeneous sampling rates, and the minimization of the investment in infrastructure for PMU communication. Solutions based on Bayesian estimation, as well as those having a distributed architectures, show great promise. The material presented in this document is tailored to both new researchers entering this field and experienced researchers wishing to become acquainted with emerging trends.

42 ENGINEERING↗

Data Quality Monitoring for the Hadron Calorimeters Using Transfer Learning for Anomaly Detection

The proliferation of sensors brings an immense volume of spatio-temporal (ST) data in many domains, including monitoring, diagnostics, and prognostics applications. Data curation is a time-consuming process for a large volume of data, making it challenging and expensive to deploy data analytics platforms in new environments. Transfer learning (TL) mechanisms promise to mitigate data sparsity and model complexity by utilizing pre-trained models for a new task. Despite the triumph of TL in fields like computer vision and natural language processing, efforts on complex ST models for anomaly detection (AD) applications are limited. In this study, we present the potential of TL within the context of high-dimensional ST AD with a hybrid autoencoder architecture, incorporating convolutional, graph, and recurrent neural networks. Motivated by the need for improved model accuracy and robustness, particularly in scenarios with limited training data on systems with thousands of sensors, this research investigates the transferability of models trained on different sections of the Hadron Calorimeter of the Compact Muon Solenoid experiment at CERN. The key contributions of the study include exploring TL’s potential and limitations within the context of encoder and decoder networks, revealing insights into model initialization and training configurations that enhance performance while substantially reducing trainable parameters and mitigating data contamination effects.

47 OTHER INSTRUMENTATION↗

In Situ Laser Induced Florescence Measurements of Fuel Dilution from Low Load to Stochastic Pre Ignition Prone Conditions

This work employs a novel laser induced fluorescence (LIF) diagnostic to measure fuel dilution in a running single cylinder research engine operated at stochastic pre ignition (SPI) and non-SPI prone conditions. Measurements of LIF based fuel dilution are quantified over a range of engine loads and fuel injection timings for two fuels. The in situ LIF measurements of fuel/lubricant interactions illustrate regions of increased fuel dilution from fuel-wall interactions and is believed to be a fundamental underpinning to generating top ring zone liquid conditions conducive to SPI. Furthermore, a novel level of dye doped in the fuel, between 50 to 500 ppm was used as the fluorescence source, at engine operating speed of 2000r/min from 5 to 18 bar of IMEPg injection timings was swept for two fuels of varying volatility. The direct real time LIF measurements highlight that there are non-linear trends in fuel dilution beyond simple dependencies of fuel volatility, injection duration or injection timing, suggesting that further understanding of spray interaction with engine surfaces and the turbulent field are needed to quantify fuel dilution effects that are conducive to SPI. Moreover, results show the potential of this diagnostic technique as an additional tool for quantifying spray and fuel mixing in fundamental studies deployable across a variety of engine loads from law to full load.

47 OTHER INSTRUMENTATION↗

Scaling open-weight large language models for hydropower regulatory information extraction: A systematic analysis

Information extraction from regulatory and technical documents using large language models (LLMs) involves practical trade-offs between extraction quality and computational cost. We evaluate eight open-weight LLMs spanning 0.6B–70B parameters on hydropower licensing documents and report deployment-oriented evidence under a unified extraction schema and evaluation protocol. Across the model set, we observe clear scale-dependent trends in both baseline extraction quality and the effectiveness of reflective reasoning (self-checking) under our fixed-prompt, no-augmentation setting. Mid-scale models often provide a favorable balance of accuracy and efficiency, whereas the smallest models show limited or inconsistent gains from the reasoning variants tested. Larger models achieve the highest overall F1 scores but incur substantially greater compute and infrastructure requirements. We further find that reliability failure modes can distort conventional metrics in this domain: in particular, high recall can coincide with systematic extraction errors when models fabricate values for fields that are absent from the source text, underscoring the importance of conservative null handling and evidence-grounded evaluation. Overall, our study provides a reproducible resource–performance comparison for open-weight LLM-based extraction in hydropower regulatory documentation and offers practical guidance for model selection under different deployment constraints.

Evaluation protocol↗