Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “batch normalization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1980

Attitude determination of Galileo spacecraft from star data

An entirely autonomous attitude determination algorithm has been developed for the dual spin Galileo spacecraft in its mission to Jupiter. A batch mode process is established which identifies three stars within the scanner's field-of-view based on the criteria of intensity and geometry. This is followed by a continuous star acquisition procedure which provides star transit times and a spacecraft spin rate estimate. A least-squares estimator then sequentially determines the spacecraft's attitude from successive star crossings by minimizing an error derived using the necessary condition of star and scanner slit normal orthogonality. Simulation results are presented, showing successful star identification and attitude convergence in the presence of nutation and star transit time uncertainty.

Wong, E. C.↗
NASA NTRS1981

Autonomous attitude determination from star data for a dual-spin planetary spacecraft

A batch mode process which identifies three reference stars within a rotor-mounted star scanner's field-of-view based on the criteria of intensity and geometry was established. The sequential mode which continuously tracks the reference stars provides star transit times and estimates of rotor's spin rate. A least-square estimator was formulated which sequentially determines the spacecraft attitude from sucessive star crossings by minimizing the error in the star and scanner slit normal orthogonality. This spacecraft attitude also provides intermittent updates for the gyro propagated inertial attitude of the despun science platform. Simulation results are presented, showing successful star identification and attitude convergence in the presence of nutation and star transit time uncertainty.

Wong, E. C.↗
DOE OSTI2023

Validation of a Proteomic Signature of Lung Cancer Risk from Bronchial Specimens of Risk-Stratified Individuals

A major challenge in lung cancer prevention and cure hinges on identifying the at-risk population that ultimately develops lung cancer. Previously, we reported proteomic alterations in the cytologically normal bronchial epithelial cells collected from the bronchial brushings of individuals at risk for lung cancer. The purpose of this study is to validate, in an independent cohort, a selected list of 55 candidate proteins associated with risk for lung cancer with sensitive targeted proteomics using selected reaction monitoring (SRM). Bronchial brushings collected from individuals at low and high risk for developing lung cancer as well as patients with lung cancer, from both a subset of the original cohort (batch 1: n = 10 per group) and an independent cohort of 149 individuals (batch 2: low risk (n = 32), high risk (n = 34), and lung cancer (n = 83)), were analyzed using multiplexed SRM assays. ALDH3A1 and AKR1B10 were found to be consistently overexpressed in the high-risk group in both batch 1 and batch 2 brushing specimens as well as in the biopsies of batch 1. Validation of highly discriminatory proteins and metabolic enzymes by SRM in a larger independent cohort supported their use to identify patients at high risk for developing lung cancer.

60 APPLIED LIFE SCIENCES↗
NASA NTRS2014

Optical Properties of Nanosatellite Hardware

Over the last decade, a number of very small satellites have been launched into space. These have been called nanosatellites (generally of a weight between 1 and 10 kg) or picosatellites (weight <1 kg). This also includes CubeSats, which are based on 10-cm cube units. With the addition of the Japanese Experiment Module (JEM) Small Satellite Orbital Deployer (J-SSOD) to the International Space Station (ISS), CubeSats are easily cycled through the JEM airlock and deployed into space (fig. 1). The number of CubeSats launched since 2003 was approaching 100 at the time of publication, and the authors expect this trend in research to continue, particularly for high school and college flight experiments. Because these spacecraft are so small, there is usually no allowance for shielding or active heating or cooling of the avionics and other hardware. Parts that are usually ignored in the thermal analysis of larger spacecraft may contribute significantly to the heat load of a tiny satellite. In addition, many small satellites have commercial-off-the-shelf (COTS) components. To reduce costs, many providers of COTS components do not include the optical and physical parameters necessary for accurate thermal analysis. Marshall Space Flight Center participated in the development and analysis of the Space Missile Defense Command-Operational Nanosatellite Effect (SMDC-ONE) and the Edison Demonstration of Smallsat Networks (EDSN) nanosatellites. These optical property measurements are documented here in hopes that they may benefit future nanosatellite and picosatellite programs and aid thermal analysis to ensure project goals are met, with the understanding that material properties may vary by vendor, batch, manufacturing process, and preflight handling. Where possible, complementary data are provided from ground simulations of the space environment and flight experiments, such as the Materials on International Space Station Experiment (MISSE) series. NASA gives no recommendation, endorsement, or preference, either expressed or implied, concerning materials and vendors used. Solar absorptance was calculated from spectral reflectance measurements made from 250 to 2,800 nm with an AZ Technology Laboratory Portable Spectroreflectometer (LPSR) model 300. ASTM E-903 was the test method used under normal laboratory conditions, and ASTM E-490 was the solar spectral irradiance data used to calculate solar absorptance. Most of the samples were flat, but stray light was minimized as much as possible with either a blackbody or black cloth as sample background. The LPSR has repeatability of approximately +/-1%, where solar absorptance is given as range, that is, from actual measurements taken across the sample. Infrared emittance measurements were made with an AZ Technology TEMP 2000A infrared reflectometer. This instrument measures the total hemispheric reflectance averaged over 3-35 micrometer wavelengths. ASTM E-408 was the test method used under normal laboratory conditions. 3 Stray light was minimized as much as possible. The TEMP 2000A has repeatability of approximately +/-0.5%, where infrared emittance is given as a range, that is, from actual measurements taken across the sample.

Finckenor, M. M.↗
NASA NTRS2003

Towards Automating Spacecraft Attitude Sensor Calibration

With a view towards reducing cost and complexity for spacecraft early mission support at the NASA Goddard Space Flight Center (GSFC), efforts are being made to automate the attitude sensor calibration process. This paper addresses one of the major components needed by such a system. The beneficiaries of an improved calibration process are missions that demand moderate to high precision attitude knowledge or that need to perform accurate attitude slews. Improved slew accuracy reduces the time needed for re-acquisition of fine-pointing after each attitude maneuver, Rapid target acquisition can be very important for astronomical targeting or for off-nadir surface feature targeting by Earth-oriented spacecraft. The normal sequence of on-orbit calibration starts with alignment calibration of the star trackers and possibly the Sun sensor. Their relative alignment needs to be determined using a sufficiently large data set so their fields of view are adequately sampled. Next, the inertial reference unit (IRU) is calibrated for corrections to its alignment and scale factors. The IRU biases are estimated continuously by the onboard attitude control system, but the IRU alignment and scale factors are usually determined on the ground using a batch-processing method on a data set that includes several slews sufficient to give full observability of all the IRU calibration parameters. Finally, magnetometer biases, alignment, and its coupling to the magnetic torquers are determined in order io improve momentum management and occasionally for use in the attitude determination system. The detailed approach used for automating calibrations will depend on whether the automated system resides on the ground or on the spacecraft with an ultimate goal of autonomous calibration. Current efforts focus on a ground-based system driving subsystems that could run either on the ground or onboard. The distinction is that onboard calibration should process the data sequentially rather than in a single large batch since onboard computer data storage is limited. Very good batch- processing calibration utilities have been developed and used extensively at NASA/GSFC for mission support but no sequential calibration utilities are available. To meet this need, this paper presents the mathematical description of a sequential IRU calibration system. The system has been tested using flight data from the Rossi X-ray Timing Explorer (RXTE) during a series of attitude slews. The paper also discusses the current state of the overall automated system and describes plans for adding sequential alignment calibration and other additions that will reduce the amount of analyst time and input.

Sedlak, Joseph↗
DOE OSTI2023

Preliminary Neutronics Design and Analysis of the Fast Modular Reactor

General Atomics is developing a new 100-MW(thermal) fast modular reactor (FMR) that provides safe, carbon-free electricity and is capable of incremental capacity additions. The modular design allows it to be factory built and assembled onsite to keep the capital cost low, while the use of dry cooling facilitates siting to complement renewables in nearly any location. The FMR uses high-assay low-enriched uranium-dioxide fuel encapsulated by recognized irradiationresistant silicon carbide composite (SiGA®) cladding that is derisked in the current accident-tolerant fuel program. The FMR fuel assembly is a hexagonal fuel bundle of 120 fuel rods. The total length of the fuel assembly is less than 4 m, with an active fuel length of 1.8 m. The fuel assemblies are configured in an annular core that is located and supported by the reactor internals. The coolant material is helium at a normal operating pressure of 7 MPa. The core is surrounded by zirconium silicide (Zr 3 Si 2 ) and graphite reflector blocks. The fuel, coolant, internals, and reflectors are contained within a reactor pressure vessel. Here, the preliminary nuclear design and analysis established the arrangement of the active core and reflector blocks. The nuclear design analyses of the FMR defined the design parameters, such as fuel enrichments, excess reactivity, fueling scheme, fuel cycle, power distribution, and control rod worth. The preliminary conceptual design determined the three-batch fueling scheme with the allowable total power peaking factor of 1.5. The average discharge burnup is 100 GW days per ton of uranium.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS2018

Solid State Air Purification System

Life support systems in spacecraft are designed to provide a safe, habitable environment for the astronauts, and one of the most significant challenges is managing acceptable air quality. Carbon dioxide (CO2) is respired normally by humans at concentrations that are toxic if inhaled directly, and as a result cabin air must be tightly managed. The Carbon Dioxide Removal Assembly (CDRA) currently on board the ISS is the best functioning technology for manned space cabins, but has two significant drawbacks:1. The CDRA requires that air be dried prior to CO2 capture, and this costs energy _ in fact, the system spends 4X more energy drying the air than in actually capturing and releasing carbon dioxide. 2. The CDRA works in batch mode, while downstream CO2 processing systems require a continuous stream of CO2. This adds unnecessary complexity, as well as a second parasitic energy loss.An ideal system would process CO2 continuously without any need for drying of the air, and without any moving parts. Such a system would require a fraction of the size and weight of the CDRA while dropping the cost of CO2 capture by 5X or more. Such a technology would be enabling for future long term manned flight missions, such as a mission to Mars. eSionic is developing a new electrochemical membrane technology using its patented innovations in electrolyte materials. In Phase I of this program eSionic has demonstrated continuous gas separation using only electricity to drive the separation, with no moving parts or pressure drops. In Phase II, eSionic will demonstrate long-term operation of the membranes consistent with the needs of NASA for this development program.

Life Support↗
NASA NTRS1975

Advances in superconducting quantum electronic microcircuit fabrication

Standard microelectronic fabrication techniques have been utilized to produce batch quantities of superconducting quantum electronic devices and circuits. The overall goal is a fabrication technology yielding circuits that are rugged and stable and capable of being fabricated controllably and reproducibly in sizeable quantities. Our progress toward this goal is presented, with primary emphasis on the most recent work, which includes the use of electron-beam lithography and techniques of hybrid microelectronics. Several prototype microcircuits have been successfully fabricated. These microcircuits are formed in a thin-film parent material consisting of layers of superconducting and normal metals, and use proximity-effect structures as the active circuit elements.

Kirschman, R. K.↗
DOE OSTI2022

Purification and Concentration of 99 Mo from a UREX raffinate

The medical isotope 99m Tc ( t ½ = 6.0 h) accounts for over 80% of isotopes used in diagnostic nuclear medicine today and is normally derived from its transient equilibrium parent 99 Mo ( t ½ = 66 h). To reduce U.S. dependence on 99 Mo derived from HEU by foreign suppliers, the NNSA/M3 program—under the American Medical Isotope Production Act—has been tasked with facilitating the work of domestic 99 Mo suppliers that do not utilize HEU. Superconducting electron linear accelerators with high-Z converter targets can generate bremsstrahlung photons and neutron fluxes that can induce photonuclear reactions and LEU fission. After sufficient production intervals, targets can be rotated out and processed while another batch is irradiated. The process flow chemistry is shown in Figure 1. The irradiated U 3 O 8 targets are retrieved and dissolved in HNO 3 ; the volatile fission products are expelled and captured during this step. The HNO 3 liquor bearing the uranyl, fission and activation products is injected into the UREX suite of liquid-liquid extraction banks. The uranyl is partitioned in typical fashion using tri-$\textit{n}$-butyl phosphate (TBP) in a hydrocarbon diluent. The raffinate—comprising mainly 99 Mo and fission products—is then injected into the MoLLE (Molybdenum Liquid-Liquid Extraction) flowsheet, where the Mo is selectively extracted by an organophosphorous acid extractant such as di-(2-ethylhexyl phosphoric acid) (HDEHP). Trace amounts of Nb, Zr, Np, I, and Te are co-extracted. The Mo is stripped using acetohydroxamic acid (AHA) and fed onto an anion exchange column. Following a series of hydroxide, HCl, and oxalic acid wash steps, the Mo can be recovered in NaOH/NaCl. A manuscript describing this process chemistry in more detail was recently published.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRS2005

Static and Turn-on Switching Characteristics of 4H-Silicon Carbide SITs to 200 deg C

Test results are presented for normally-off 4H-SiC Static Induction Transistors (SITs) intended for power switching and are among the first normally-off such devices realized in SiC. At zero gate bias, the gate p-n junction depletion layers extend far enough into the conduction channel to cut off the channel. Application of forward gate bias narrows the depletion regions, opening up the channel to conduction by majority carriers. In the present devices, narrow vertical channels get pinched by depletion regions from opposite sides. Since the material is SiC, the devices are usable at temperatures above 150 C. Static curve and pulse mode switching observations were done at selected temperatures up to 200 C on a device with average static characteristics from a batch of similar devices. Gate and drain currents were limited to about 400 mA and 3.5 A, respectively. The drain voltage was limited to roughly 300 V, which is conservative for this 600 V rated device. At 23 C, 1 kW, or even more, could be pulse mode switched in 65 ns (10 to 90 percent) into a 100 load. But at 200 C, the switching capability is greatly reduced in large part by the excessive gate current required. Severe collapse of the saturated drain-to-source current was observed at 200 C. The relation of this property to channel mobility is reviewed.

Niedra, Janis M.↗
NASA NTRS2016

Hindlimb Suspension (HLS) in Rodents for the Study of Intracranial Pressure, Molecular and Histologic Changes in the Eye, and CSF Production Regulation and Resorption: A Status Report of Two Studies

This status report corresponds to two studies tied to an animal experiment being executed at the University of California Davis (Charles Fuller's laboratory). The animal protocol uses the well-documented rat hindlimb suspension (HLS) model, to examine the relationship between cephalic fluid shifts and the regulation of intracranial (ICP) and intraocular (IOP) pressures as well as visual system structure and function. Long Evans rats are subjected to HLS durations of 7, 14, 28 and 90 days. Subgroups of the 90-day animals are studied for recovery periods of 7, 14, 28 or 90 days. All HLS subjects have age-matched cage controls. Various animal cohorts are planned for this study: young males, young females and old males. In addition to the live measures (ICP by telemetry, IOP and retinal parameters by optical coherence tomography) which are shared with the Fuller study, the specific outcomes for this study include: -Gene expression analysis of the retina -Histologic analysis - Analysis of the microvasculature of retina flat mounts by NASA's VESsel GENeration Analysis (VESGEN) Software. To date, the young male and female cohorts are being completed. Due to the need to keep technical variation to a minimum, the histologic and genomic analyses have been delayed until all samples from each cohort are available and can be processed in a single batch per cohort. The samples received so far correspond to young males sacrificed at 7,14, 28 and 90 days of HLS and at 90 days of recovery; and from young females sacrificed at 7, 14 and 28 of HLS. A complementary study titled: "A gene expression and histologic approach to the study of cerebrospinal fluid (CSF) production and outflow in hindlimb suspended rats" seeks to study the molecular components of CSF production and outflow modulation as a result of HLS, bringing a molecular and histologic approach to investigate genome wide expression changes in the arachnoid villi and choroid plexus of HLS rats compared to rats in normal posture.

Theriot, C. A.↗
NASA NTRS1971

Vacuum distillation: vapor filtered-catalytic oxidation water reclamation system utilizing radioisotopes

The development of a functional model water reclamation system is discussed. The system produces potable water by distillation from the urine and respiration-perspiration condensate at the normal rate generated by four men. Basic processes employed are vacuum distillation, vapor filtration, vapor phase catalytic oxidation, and condensation. The system is designed to use four 75-watt isotope heaters for distillation thermal input, and one 45-watt isotope for the catalytic oxidation unit. The system is capable of collecting and storing urine, and provides for stabilizing the urine by chemical pretreatment. The functional model system is designed for operation in a weightless condition with liquid-vapor phase separators for the evaporator still, and centrifugal separators for urine collection and vapor condensation. The system provides for storing and dispensing reclaimed potable water. The system operates in a batch mode for 40 days, with urine residues accumulating in the evaporator. The evaporator still and residue are removed to storage and replaced with a fresh still for the next 40-day period.

Honegger, R. J.↗
NASA NTRS1988

Real time thermal imaging of high temperature semiconductor melts

A real time thermal imaging system with temperature resolution better than + or - 1 C and spatial resolution of better than 0.5 mm was developed and applied to the analysis of melt surface thermal field distributions in both Czochralski and liquid encapsulated Czochralski (LEC) growth configurations. The melt is viewed in near normal incidence by a high resolution charge coupled device camera to which is attached a very narrow bandpass filter. The resulting image is digitized and processed using a pipelined pixel processor operating at an effective 40 million operations per second thus permitting real time high frequency spatial and temporal filtering of the high temperature scene. A multi-pixel averaging algorithm was developed which permits localized, low noise sensing of temperature variations at any location in the hot zone as a function of time. This signial is used to implement initial elements of a feedforward growth control scheme which is aimed at reducing disturbances to the melt caused by the batch nature of the growth process. The effect of magnetic melt stabilization on radial melt temperature distributions was measured using this technique. Problems associated with residual internal reflections and non-optimized path geometry are discussed.

Wargo, Michael J.↗
NASA NTRS2000

Model of ASTM Flammability Test in Microgravity: Iron Rods

There is extensive qualitative results from burning metallic materials in a NASA/ASTM flammability test system in normal gravity. However, this data was shown to be inconclusive for applications involving oxygen-enriched atmospheres under microgravity conditions by conducting tests using the 2.2-second Lewis Research Center (LeRC) Drop Tower. Data from neither type of test has been reduced to fundamental kinetic and dynamic systems parameters. This paper reports the initial model analysis for burning iron rods under microgravity conditions using data obtained at the LERC tower and modeling the burning system after ignition. Under the conditions of the test the burning mass regresses up the rod to be detached upon deceleration at the end of the drop. The model describes the burning system as a semi-batch, well-mixed reactor with product accumulation only. This model is consistent with the 2.0-second duration of the test. Transient temperature and pressure measurements are made on the chamber volume. The rod solid-liquid interface melting rate is obtained from film records. The model consists of a set of 17 non-linear, first-order differential equations which are solved using MATLAB. This analysis confirms that a first-order rate, in oxygen concentration, is consistent for the iron-oxygen kinetic reaction. An apparent activation energy of 246.8 kJ/mol is consistent for this model.

Steinberg, Theodore A↗
NASA NTRS2015

An Empirical State Error Covariance Matrix Orbit Determination Example

State estimation techniques serve effectively to provide mean state estimates. However, the state error covariance matrices provided as part of these techniques suffer from some degree of lack of confidence in their ability to adequately describe the uncertainty in the estimated states. A specific problem with the traditional form of state error covariance matrices is that they represent only a mapping of the assumed observation error characteristics into the state space. Any errors that arise from other sources (environment modeling, precision, etc.) are not directly represented in a traditional, theoretical state error covariance matrix. First, consider that an actual observation contains only measurement error and that an estimated observation contains all other errors, known and unknown. Then it follows that a measurement residual (the difference between expected and observed measurements) contains all errors for that measurement. Therefore, a direct and appropriate inclusion of the actual measurement residuals in the state error covariance matrix of the estimate will result in an empirical state error covariance matrix. This empirical state error covariance matrix will fully include all of the errors in the state estimate. The empirical error covariance matrix is determined from a literal reinterpretation of the equations involved in the weighted least squares estimation algorithm. It is a formally correct, empirical state error covariance matrix obtained through use of the average form of the weighted measurement residual variance performance index rather than the usual total weighted residual form. Based on its formulation, this matrix will contain the total uncertainty in the state estimate, regardless as to the source of the uncertainty and whether the source is anticipated or not. It is expected that the empirical error covariance matrix will give a better, statistical representation of the state error in poorly modeled systems or when sensor performance is suspect. In its most straight forward form, the technique only requires supplemental calculations to be added to existing batch estimation algorithms. In the current problem being studied a truth model making use of gravity with spherical, J2 and J4 terms plus a standard exponential type atmosphere with simple diurnal and random walk components is used. The ability of the empirical state error covariance matrix to account for errors is investigated under four scenarios during orbit estimation. These scenarios are: exact modeling under known measurement errors, exact modeling under corrupted measurement errors, inexact modeling under known measurement errors, and inexact modeling under corrupted measurement errors. For this problem a simple analog of a distributed space surveillance network is used. The sensors in this network make only range measurements and with simple normally distributed measurement errors. The sensors are assumed to have full horizon to horizon viewing at any azimuth. For definiteness, an orbit at the approximate altitude and inclination of the International Space Station is used for the study. The comparison analyses of the data involve only total vectors. No investigation of specific orbital elements is undertaken. The total vector analyses will look at the chisquare values of the error in the difference between the estimated state and the true modeled state using both the empirical and theoretical error covariance matrices for each of scenario.

Frisbee, Joseph H., Jr.↗
DOE OSTI2024

Development of a SnO 2 -based 44 Ti/ 44 Sc generator for medical applications

Towards application of 44 Sc for diagnostic nuclear medicine, a 44 Ti/ 44 Sc generator based on an inorganic resin has been evaluated. Unlike other radionuclide generators used for medical applications, the long-term retention of the parent 44 Ti is vital due to its long half life. In this work, tin dioxide (SnO 2 ), a robust inorganic-based resin, has been synthesized and used as the stationary phase for a 44 Ti/ 44 Sc generator. The sorption behavior of 44 Ti/ 44 Sc was tested on SnO 2 with varying acids, concentrations, and times. Preliminary batch study results showed >88 % 44 Ti retention to the resin at lower acid concentrations (0.05 M HNO 3 and 0.05 M HCl). A pilot generator was evaluated for a year, demonstrating 85.3 ± 2.8 % 44 Sc elution yields and 0.71 ± 0.14 % 44 Ti breakthrough in 5 M HNO 3 . Based on capacity studies, a 7.4 MBq (200 µCi) upscaled generator system was constructed for further evaluation of the SnO 2 resin stability and the efficacy of the eluted 44 Sc for radiolabeling. 44 Sc could be regularly eluted from this generator in 5 M HNO 3 with an overall average radiochemical yield 84.7 ± 9.5 %. Post-elution processing of the 44 Sc with DGA-normal resin removed all 44 Ti present and allowed for high 44 Sc-DOTA labeling yields of 94.2 ± 0.5 %. Overall, SnO 2 has been shown to be a viable material for a 44 Ti/ 44 Sc generator.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRSDate not supplied

NASA GeneLab Multi-study Visualization Portal

NASA GeneLab has helped advance the field of Space Biology by providing a public repository where researchers can store, share, analyze and visualize the results of space flight related omics experiments. The GeneLab data visualization portal allows any user, regardless of bioinformatics knowledge or access to computational resources, to interact with the experimental data, draw their own conclusions, and gain insights about the effects of space on living systems. These tools help democratize scientific research and foster the NASA Open Science initiative. The new multi-study feature of the GeneLab visualization platform allows users to mine study metadata from RNA sequencing (RNA-seq) experiments to identify samples of interest by filtering datasets based on organism, tissue, assay technology type, and/or factor. Once samples are selected from multiple datasets, users can combine and normalize the sample data, then utilize the visualization displays, including Principal Component Analysis (PCA) plots, to assess sample distributions. Finally, users can perform differential gene expression analysis on the combined data and visualize the results through PCA plots, Volcano plots, Pair plots, Heatmap, Ideogram and Gene Set Enrichment Analysis. All user-generated results and visualizations will be available for download. Here, we present a biological study using samples from multiple GeneLab RNA-seq datasets and analyzed using the multi-study visualization platform to demonstrate inter- and intra-study variability, as well as commonly differentially expressed genes between spaceflight and ground control conditions across datasets. This new feature opens a wide range of possibilities and opportunities for further development including combining other assay technology types and integration with batch effect correction techniques and machine learning applications. Overall, this tool allows users to increase the statistical power of individual experiments, validate hypothesis, identify patterns, and opens the door to new and exciting research.

space biology↗
DOE OSTI2025

NLR HPC Kestrel Jobs Data

Overview: Anonymized job-level records from the Kestrel HPC system at the National Laboratory of the Rockies (NLR). Each record represents a Slurm batch job with scheduling metadata, resource requests, utilization, energy estimates, and efficiency metrics. Sensitive fields (user, account, job name, submit line, working directory, submit script, and job type) are replaced with 7-character cryptographic hashes. System & Timeframe: Kestrel is located at the NLR campus. Standard compute nodes have 104 cores and 256 GB RAM; bigmem nodes have 2,000 GB. GPU nodes (gpu-h100 partition) use NVIDIA H100 GPUs. Data covers jobs submitted August 2023 through December 2025. Funding provided by the U.S. Department of Energy, EERE. Files: esif.hpc.kestrel.job-anon.zip — Anonymized job records (Hive-partitioned Parquet) datacard.md — Full dataset documentation ~11 million rows, 50 variables. Readable with PyArrow, pandas, DuckDB, Apache Spark, or any Parquet-compatible tool. Data Collection: Jobs collected via sacct with timezone-aware export (SLURM_TIME_FORMAT="%Y-%m-%dT%H:%M:%S%z"), loaded into PostgreSQL. Calculated columns updated via database triggers and batch functions. All timestamps use timestamptz and correctly handle DST transitions. Preprocessing: Anonymization of name, user, account, submit_line, work_dir, submit_script, and job_type via 7-char hex hashes Derived columns: queue_wait, cpu_eff, max/min/avg_mem_eff, energy estimates Simplified job state mapping (e.g., "CANCELLED by 132357" → "CANCELLED") Boolean flags: python_job, reframe_job Temporal decomposition: year, month, day, day_of_week, hour, minute from submit_time Shared node tracking: shared_job_count, nodes_shared, jobs_shared Key Variables: Scheduling: job_id, partition, state_simple, submit_time, start_time, end_time, queue_wait Resources: nodes_req/used, processors_req/used, memory_req, wallclock_req/used, gpus_requested Efficiency: cpu_eff, max/min/avg_mem_eff Energy: cpu_energy_tdp_estimated_max/used_watt_hours, consumed_energy_raw_joules, consumed_energy_raw_watt_hours Sharing: shared_job_count, nodes_shared, jobs_shared Partitions: short, standard, debug, gpu-h100 Job States: CANCELLED, COMPLETED, FAILED, PENDING, RUNNING QoS Levels: normal, high Important Notes: Timestamps include timezone offsets; DST transitions are handled correctly, though adding intervals across DST boundaries requires offset adjustment shared_job_count reflects physical node co-residency, not use of the shared partition Job step records and raw Slurm JSONB fields are excluded Do not attempt to re-identify individuals from hashed fields

97 MATHEMATICS AND COMPUTING↗