Beyond Leaderboards: Tokenomics of Agentic Small Language Model Ensembles
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Engineering Papers
Results for “evaluation protocols”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Field Geologic Observation and Sample Collection Strategies for Planetary Surface Exploration: Insights from the 2010 Desert RATS Geologist Crewmembers
Observation is the primary role of all field geologists, and geologic observations put into an evolving conceptual context will be the most important data stream that will be relayed to Earth during a planetary exploration mission. Sample collection is also an important planetary field activity, and its success is closely tied to the quality of contextual observations. To test protocols for doing effective planetary geologic field- work, the Desert RATS(Research and Technology Studies) project deployed two prototype rovers for two weeks of simulated exploratory traverses in the San Francisco volcanic field of northern Arizona. The authors of this paper represent the geologist crew members who participated in the 2010 field test.We document the procedures adopted for Desert RATS 2010 and report on our experiences regarding these protocols. Careful consideration must be made of various issues that impact the interplay between field geologic observations and sample collection, including time management; strategies relatedtoduplicationofsamplesandobservations;logisticalconstraintson the volume and mass of samples and the volume/transfer of data collected; and paradigms for evaluation of mission success. We find that the 2010 field protocols brought to light important aspects of each of these issues, and we recommend best practices and modifications to training and operational protocols to address them. Underlying our recommendations is the recognition that the capacity of the crew to flexibly execute their activities is paramount. Careful design of mission parameters, especially field geologic protocols, is critical for enabling the crews to successfully meet their science objectives.
Hurtado, Jose M., Jr.↗
ATM QoS Experiments Using TCP Applications: Performance of TCP/IP Over ATM in a Variety of Errored Links
Asynchronous Transfer Mode (ATM) Quality of Service (QoS) experiments using the Transmission Control Protocol/Internet Protocol (TCP/IP) were performed for various link delays. The link delay was set to emulate a Wide Area Network (WAN) and a Satellite Link. The purpose of these experiments was to evaluate the ATM QoS requirements for applications that utilize advance TCP/IP protocols implemented with large windows and Selective ACKnowledgements (SACK). The effects of cell error, cell loss, and random bit errors on throughput were reported. The detailed test plan and test results are presented herein.
Frantz, Brian D.↗
Recovery of postural equilibrium control following space flight
DSO 605 represents the first large study of balance control following spaceflight. Data collected during DSO 605 confirm the theory that postural ataxia following short duration spaceflight is of vestibular origin. We used the computerized dynamic posturography technique developed by Nashner et al. to study the role of the vestibular system in balance control in astronauts during quiet stance before and after spaceflight. Our results demonstrate unequivocally that balance control is disrupted in all astronauts immediately after return from space. The most severely affected returning crew members performed in the same way as vestibular deficient patients exposed to this test battery. We conclude that otolith mediated spatial reference provided by the terrestrial gravitational force vector is not used by the astronauts balance control systems immediately after spaceflight. Because the postflight ataxia appears to be mediated primarily by CNS adaptation to the altered vestibular inputs caused by loss of gravitational stimulation, we believe that intermittent periods of exposure to artificial gravity may provide an effective in-flight countermeasure. Specifically, we propose that in-flight centrifugation will allow crew members to retain their terrestrial sensory-motor adapted states while simultaneously developing microgravity adapted states. The dual-adapted astronaut should be able to make the transition from microgravity to unit gravity with minimal sensory-motor effects. We have begun a ground based program aimed at developing short arm centrifuge prescriptions designed to optimize adaptation to altered gravitational environments. Results from these experiments are expected to lead directly to in-flight evaluation of the proposed centrifuge countermeasure. Because our computerized dynamic posturography system was able to (1) quantify the postflight postural ataxia reported by crew members and observed by flight surgeons and scientists, (2) track the recovery of normal (preflight) balance control, (3) differentiate between rookie and veteran subjects, and (4) provide normative and clinical databases for comparison, and because our study successfully characterized postflight balance control recovery in a large cross-section of Shuttle crew members, we recommend that this system and protocol be adopted as a standard dependent measure for evaluating the efficacy of countermeasures and/or evaluating the postflight effects of changing mission durations or activities.
Paloski, William H.↗
An Approach to Evaluate Precision and Inter-Laboratory Variability of Flammability Test Methods for Aerospace Materials
Materials selection for spacecraft is based on conventional flammability or ignition sensitivity acceptance tests. Current procedures for determining the inter-laboratory repeatability and reproducibility of aerospace materials flammability tests are not considering the dependence of data variability on test conditions and consequently attempts to characterize the precision of these methods were not successful. The inter-laboratory data variability is determined with tests conducted under arbitrary conditions, which consequently may not provide sufficient information to enable adequate determination of a method's precision. For evaluating the precision of NASA's flammability test methods, the protocol recommended includes selecting critical parameters and determining the 50% failure point by considering the specific failure criteria of each method using the critical parameter as a variable. Upon performing inter-laboratory round robin testing using this approach, the laboratories' performance could be evaluated by comparing the repeatability of the 50% failure point and/or the repeatability of critical conditions where the probabilities of passing and failing are unity, i.e., the transition zone repeatability. When a sufficient amount of data has been acquired with this method, an adequate estimation of precision of aerospace materials flammability test methods will be possible.
Hirsch, David↗
A Simple XML Producer-Consumer Protocol
This document describes a simple XML-based protocol that can be used for producers of events to communicate with consumers of events. The protocol described here is not meant to be the most efficient protocol, the most logical protocol, or the best protocol in any way. This protocol was defined quickly and it's intent is to give us a reasonable protocol that we can implement relatively easily and then use to gain experience in distributed event services. This experience will help us evaluate proposals for event representations, XML-based encoding of information, and communication protocols. The next section of this document describes how we represent events in this protocol and then defines the two events that we choose to use for our initial experiments. These definitions are made by example so that they are informal and easy to understand. The following section then proceeds to define the producer-consumer protocol we have agreed upon for our initial experiments.
Smith, Warren↗
Simulation of Isotopic Concentrations and Gamma Spectra from Dynamic Fission Sources
A tool was developed to rapidly generate synthetic gamma-ray spectra to evaluate safeguards material control and accounting methods for liquid-fueled molten salt reactors. Molten salt reactor operations pose unique challenges to nuclear safeguards methods and protocols compared to deployed reactors designs (e.g., light water reactors). This research evaluates the use of gamma-ray spectroscopy to monitor fission product isotopic flow through a reactor model to understand expected operations and investigate changes to the spectra with material diversion scenarios. The large design space of molten salt reactors (e.g., liquid-fueled, liquid-cooled, online separations) could potentially lead to many measurement points within the reactor system. The developed analytical tool generates and evaluates synthetic gamma-ray spectra from dynamic reactor simulations by extracting isotopic inventory to generate source terms. An implementation in the Gamma Detector Response and Analysis Software (GADRAS) Application Program Interface (API) uses the source terms, a model of the reactor component, a detector response function, and measurement plan to quickly generate and analyze spectra. Prospective measurements are then evaluated in the more accurate but slower Geant4 simulations. Utilization of the developed modeling tool and analysis of the subsequent spectra enables optimization of collimation, shielding requirements, and expected count rates that are used to determine key measurement points in the modeled reactor design.
O'Brien, Sean↗
Protocol for assembling and operating bipolar membrane water electrolyzers
Renewable energy-driven bipolar membrane water electrolyzers (BPMWEs) are a promising technology for sustainable production of hydrogen from seawater and other impure water sources. Here, we present a protocol for assembling BPMWEs and operating them in a range of water feedstocks, including ultra-pure deionized water and seawater. We describe steps for membrane electrode assembly preparation, electrolyzer assembly, and electrochemical evaluation. For complete details on the use and execution of this protocol, please refer to Marin et al. (2023).
Rios Amador, Isabela↗
Evaluating Synthetic Smart Meter Locations For Communication System Modeling
An important part of good communication models for smart grid applications, particularly when wireless protocols are used, is the location information of the nodes. We’ve developed metrics to assist in evaluating whether a given model with such information is representative of feeders found in the world. These metrics are applied to a set of feeder models with known good location information for the smart meter locations and compared to a set of feeder models with similar location information that is not expected to be representative of real-world feeders. The comparison reveals that the suspect models do not pass statistical tests utilizing the developed metrics, providing initial validation of the analysis technique.
smart meter, feeder model, GridLAB-D↗
Tools and Technologies Needed for Conducting Planetary Field Geology While On EVA: Insights from the 2010 Desert RATS Geologist Crewmembers
Observation is the primary role of all field geologists, and geologic observations put into an evolving conceptual context will be the most important data stream that will be relayed to Earth during a planetary exploration mission. Sample collection is also an important planetary field activity, and its success is closely tied to the quality of contextual observations. To test protocols for doing effective planetary geologic fieldwork, the Desert RATS (Research and Technology Studies) project deployed two prototype rovers for two weeks of simulated exploratory traverses in the San Francisco volcanic field of northern Arizona. The authors of this paper represent the geologist crewmembers who participated in the 2010 field test. We document the procedures adopted for Desert RATS 2010 and report on our experiences regarding these protocols. Careful consideration must be made of various issues that impact the interplay between field geologic observations and sample collection, including time management; strategies related to duplication of samples and observations; logistical constraints on the volume and mass of samples and the volume/transfer of data collected; and paradigms for evaluation of mission success. We find that the 2010 field protocols brought to light important aspects of each of these issues, and we recommend best practices and modifications to training and operational protocols to address them. Underlying our recommendations is the recognition that the capacity of the crew to "flexibly execute" their activities is paramount. Careful design of mission parameters, especially field geologic protocols, is critical for enabling the crews to successfully meet their science objectives.
Young, Kelsey↗
NIST Efforts to Quality-Assure Gunpowder Measurements
In the past few years, the National Institute for Standards and Technology (NIST) has been promoting the idea of quantitatively determining the additives in smokeless gunpowder using micellar capillary electrophoresis as a means of investigating the criminal use of hand guns and pipe bombs. As a part of this effort, we have evaluated both supercritical fluid and ultrasonic solvent extractions for the quantitative recovery of nitroglycerin (NG), diphenylamine (DPA), N-nitrosodiphenylamine (NnDPA), and ethyl centralite (EC) from gunpowder. Recoveries were evaluated by repeat extraction and matrix spiking experiments. The final extraction protocol provides greater than 95 percent recoveries. To help other researches validate their own analytical method for additive determinations, NIST is exploring the development of a standard reference material, Additives in Smokeless Gunpowder. The evaluated method is being applied to two double-base (NG-containing) powders, one stabilized with diphenylamine and the other with ethyl centralite. As part of this reference material development effort, we are conducting an interlaboratory comparison exercise among the forensic and military gunpowder measurement community.
MacCrehan, William A.↗
Exploiting Aerobic Fitness To Reduce Risk Of Hypobaric Decompression Sickness
Decompression sickness (DCS) is multivariable. But we hypothesize an aerobically fit person is less likely to experience hypobaric DCS than an unfit person given that fitness is exploited as part of the denitrogenation (prebreathe, PB) process prior to an altitude exposure. Aerobic fitness is peak oxygen uptake (VO2pk, ml/kg/min). METHODS: Treadmill or cycle protocols were used over 15 years to determine VO2pks. We evaluated dichotomous DCS outcome and venous gas emboli (VGE) outcome detected in the pulmonary artery with Doppler ultrasound associated with VO2pk for two classes of experiments: 1) those with no PB or PB under resting conditions prior to ascent in an altitude chamber, and 2) PB that included exercise for some part of the PB. There were 165 exposures (mean VO2pk 40.5 +/- 7.6 SD) with 25 cases of DCS in the first protocol class and 172 exposures (mean VO2pk 41.4 +/- 7.2 SD) with 25 cases of DCS in the second. Similar incidence of the DCS (15.2% vs. 14.5%) and VGE (45.5% vs. 44.8%) between the two classes indicates that decompression stress was similar. The strength of association between outcome and VO2pk was evaluated using univariate logistic regression. RESULTS: An inverse relationship between the DCS outcome and VO2pk was evident, but the relationship was strongest when exercise was done as part of the PB (exercise PB, coef. = -0.058, p = 0.07; rest or no PB, coef. = -0.005, p = 0.86). There was no relationship between VGE outcome and VO2pk (exercise PB, coef. = -0.003, p = 0.89; rest or no PB, coef. = 0.014, p = 0.50). CONCLUSIONS: A significant change in probability of DCS was associated with fitness only when exercise was included in the denitrogenation process. We believe a fit person that exercises during PB efficiently eliminates dissolved nitrogen from tissues.
Conkin, Johnny↗
Specialized physiological studies in support of manned space flight
The areas of physiological research reported include: (1) evaluation of the single-breath method for determining cardiac output, (2) optimum protocol for the assessment of cardio-pulmonary competence, (3) body fluids and electrolytes under conditions of single and combined stress, (4) re-evaluation of the open-circuit method for measuring metabolic rate with regard to the alleged metabolic production of gaseous nitrogen, and (5) the use of the forced-oscillation method to determine total respiratory conductance in healthy subjects and pulmonary patients.
Luft, U. C.↗
Exploiting Aerobic Fitness to Reduce Risk of Hypobaric Decompression Sickness
Decompression sickness (DCS) is multivariable. But we hypothesize an aerobically fit person is less likely to experience hypobaric DCS than an unfit person given that fitness is exploited as part of the denitrogenation (prebreathe, PB) process prior to an altitude exposure. Aerobic fitness is peak oxygen uptake (VO2pk, ml/kg/min). Treadmill or cycle protocols were used over 15 years to determine VO2pks. We evaluated dichotomous DCS outcome and venous gas emboli (VGE) outcome detected in the pulmonary artery with Doppler ultrasound associated with VO2pk for two classes of experiments: 1) those with no PB or PB under resting conditions prior to ascent in an altitude chamber, and 2) PB that included exercise for some part of the PB. There were 165 exposures (mean VO2pk 40.5 plus or minus 7.6 SD) with 25 cases of DCS in the first protocol class and 172 exposures (mean VO2pk 41.4 plus or minus 7.2 SD) with 25 cases of DCS in the second. Similar incidence of the DCS (15.2% vs. 14.5%) and VGE (45.5% vs. 44.8%) between the two classes indicates that decompression stress was similar. The strength of association between outcome and VO2pk was evaluated using univariate logistic regression. An inverse relationship between the DCS outcome and VO2pk was evident, but the relationship was strongest when exercise was done as part of the PB (exercise PB, coef. = -0.058, p = 0.07; rest or no PB, coef. = -0.005, p = 0.86). There was no relationship between VGE outcome and VO2pk (exercise PB, coef. = -0.003, p = 0.89; rest or no PB, coef. = 0.014, p = 0.50). A significant change in probability of DCS was associated with fitness only when exercise was included in the denitrogenation process. We believe a fit person that exercises during PB efficiently eliminates dissolved nitrogen from tissues.
Conkin, J.↗
Molecular Dynamics Driven by the Many-Body Expansion (MBE-MD)
Here, we present a protocol for classical and nuclear quantum dynamics, in which the energies and forces are generated by the many-body expansion (MBE), and apply it to water clusters using the TTM2.1-F and MB-Pol interaction potentials at various temperatures. We carry out MBE-MD classical and nuclear quantum dynamical simulations in which the energies and forces of the full system are approximated by the 2-, 3-, and 4-body terms of the MBE expansion and compare the average potential and the vibrational density of states (VDOS) with the full simulation, i.e., the one for which no MBE is used. Our results indicate that the thermally averaged potential energy from the MBE up to the 4-body term converges with near identical behavior to the one from the full simulation. The 3-body makes a substantial contribution (~20%) to the energy, whereas the 4- body is necessary for obtaining quantitatively accurate energetics and forces, albeit making a small contribution to each (~2%). We further show that the harmonic frequencies are reproduced to within a few wavenumbers (cm -1 ) at the 4-body level, and that the slowest modes to converge with the MBE rank are those involving the strongest hydrogen bonds. Anharmonicity exacerbates this effect, so that a 4-body description of the energies and forces is needed to achieve accurate anharmonic vibrational frequencies in the hydrogen-bonded OH-stretching region. We also discuss the asymptotic scaling of the MBE-MD protocol with respect to the cost of the underlying potential energy evaluation, suggesting that electronic structure methods that scale at least as N 4 ,N being the size of the system, are needed to result in savings over the traditional full MD simulation. We anticipate that MBE-MD protocol can evolve into a powerful and practical method, which will allow for highly accurate ab initio MD simulations on a much broader range of molecular systems than can be currently handled.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Status of the Characterization of DEs from the Full Circumference Examination of the Inner Container Closure Weld Region (FY2020)
One of the main focus areas of the 3013 Surveillance Program is a thorough evaluation of the inner container closure weld region (ICCWR) opened for destructive examination (DE). As part of the protocol to investigate the corrosion in the ICCWR a laser confocal microscope (LCM) is used to perform close visual examination of the surface and measurements of corrosion features on the surface. DE containers from FY13 through FY16 were screened with three candidates selected for full circumference evaluation (FCE) according to the ICCWR examination protocol, During the FCE, FY16 DE05 and FY15 DE07 showed suspect major corrosion events, FY16 DE05 Section C2 shows two crack-like features, identified as Denebola and Draco. Both features are located at the boundary of Zone 2 and Zone 3. Consequently, Section C2 of FY16 DE05 was selected for examination by serial metallography at Savannah River National Laboratory (SRNL). For FY15 DE07 the suspect corrosion events were observed on Sections Cl and C2. Section Cl shows one crack-like feature, identified as Acrux. Section C2 shows three crack-like features, identified as Bellatrix, Cursa Minor and Cursa Major. Unlike Acrux and Bellatrix, which are located at the boundary of Zone 2 and Zone 3, Cursa Minor and Cursa Major are located in Zone 2. Sections Cl and C2 of FY15 DE07 were sent to Los Alamos National Laboratory (LANE) for characterization by X-Ray Tomography (XRT).
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Estimating uncertainty: A Bayesian approach to modelling photosynthesis in C3 leaves
The Farquhar-von Caemmerer-Berry (FvCB) model is extensively used to model pho-tosynthesis from gas exchange measurements. Since its publication, many methods have been developed to measure, or more accurately estimate, parameters of this model. Here, we have created a tool that uses Bayesian statistics to fit photosyn-thetic parameters using concurrent gas exchange and chlorophyll fluorescence mea-surements whilst evaluating the reliability of the parameter estimation. We have tested this tool on synthetic data and experimental data from rice leaves. Our results indicate that reliable parameter estimation can be achieved whilst only keeping one parameter, Km, that is, Michaelis constant for CO2 by Rubisco, prefixed. Additionally, we show that including detailed low CO2 measurements at low light levels increases reliability and suggests this as a new standard measurement protocol. By providing an estimated distribution of parameter values, the tool can be used to evaluate the quality of data from gas exchange and chlorophyll fluorescence measurement proto-cols. Compared to earlier model fitting methods, the use of a Bayesian statistics-based tool minimizes human interaction during fitting, reducing the subjectivity which is essential to most existing tools. A user friendly, interactive Bayesian tool script is provided.
Bayesian statistics, leaf photosynthesis, mesophyl↗
Automated Controller Hardware-In-The-Loop Testbed for EV Charger Resilience Analysis
This paper focuses on the development of a tool that includes an automated testbed with controls, protection, and communications integrated into a real-time system to provide a platform to generate data sets for failure modes and effects analysis. This tool establishes a value for automation of data generation for different scenarios and addresses the gap of nonexistent field data for different applications and use cases. The features of this tool can further be expanded to include multiple power electronics models, communication protocols, and scaled system architectures. This general framework was evaluated for a DC fast charger system use case to provide quantitative solution for resiliency.
Starke, Michael↗