SEARCH · Engineering Papers

Results for “science data processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

All sources NASA NTRS DOE OSTI

NASA NTRS2003

NASA's Scientific Agenda for GPM Mission

The objectives of the Global Precipitation Measurement (GPM) Mission are to: 1) Understand the horizontal and vertical structure of rainfall, its macro- and micro-physical nature, and its associated latent heating, 2) Train and calibrate retrieval algorithms for constellation radiometers, 3) Provide sufficient global sampling to significantly reduce uncertainties in short-term rainfall accumulations, and 4) Extend scientific and societal applications. The GPM mission design consists of a core satellite, constellation satellties, precipitation validation sites for error characterization, and a precipitation processing center. This viewgraph presentation profiles the science goals of the mission, and its capability for producing climate data and weather predictions.

Smith, Eric A.↗

NASA NTRS2012

Space Weathering Investigations Enabled by NASA's Virtual Heliophysical Observatories

Structural and chemical impact of the heliospheric space environment on exposed planetary surfaces and interplanetary dust grains may be generally defined as space weathering . In the inner solar system, from the asteroid belt inwards towards the Sun, the surface regolith structures of airless bodies are primarily determined by cumulative meteoritic impacts over billions of years, but the molecular composition to meters in depth can be substantially modified by irradiation effects. Plasma ions at eV to keV energies may both erode uppermost surfaces by sputtering, and implant or locally produce exogenic material, e.g. He-3 and H2O, while more energetic ions drive molecular change through electronic ionization. Galactic cosmic ray ions and more energetic solar ions can impact chemistry to meters in depth. High energy cosmic ray interactions produce showers of secondary particles and energetic photons that present hazards for robotic and human exploration missions but also enable detection of potentially useable resources such as water ice, oxygen, and many other elements. Surface sputtering also makes ejected elemental and molecular species accessible for in-situ compositional analysis by spacecraft with ion and neutral mass spectrometers. Modeling of relative impacts for these various space weathering processes requires knowledge of the incident species-resolved ion flux spectra at plasma to cosmic ray energies and as integrated over varying time scales. Although the main drivers for investigations of these processes come from NASA's planetary science and human exploration programs, the NASA heliophysics program provides the requisite data measurement and modeling resources to enable specification of the field & plasma and energetic particle irradiation environments for application to space weather and surface weathering investigations. The Virtual Heliospheric Observatory (VHO), Virtual Energetic Particle Observatory (VEPO), Lunar Solar Origins Exploration (LunaSOX), and Space Physics Data Facility (SPDF) services now provide a wide range of inner heliospheric spacecraft data that can be applied to space weathering of potential exploration destinations including the Moon, asteroids, and the moons of Mars, as well to radiation hazard assessment for the spacecraft and human explorers. For example, the new VEPO service for time-averaging of multi-source ion flux spectra enables the specification of composite flux spectra from a variety of ongoing and legacy missions for applications to surface interaction modeling. Apollo to Artemis data resources of LunaSOX enable specific space weathering investigations for the Moon, while VHO more generally covers the space field and plasma environments of the inner and outer solar system from the sunward-most perihelia of the twin Helios spacecraft to the ongoing heliosheath passages of the twin Voyagers. Composite multi-source spectra from VEPO can also be applied to the continuing compilation of accumulated 1-AU fluence spectra, mostly contributed by solar wind plasma and energetic particle events, for determination of time-averaged particle compositional and kinetic energy output from the Sun and for modeling of long-term irradiation impacts on planetary surfaces.

Cooper, John F.↗

NASA NTRS2012

QuakeSim 2.0

QuakeSim 2.0 improves understanding of earthquake processes by providing modeling tools and integrating model applications and various heterogeneous data sources within a Web services environment. QuakeSim is a multisource, synergistic, data-intensive environment for modeling the behavior of earthquake faults individually, and as part of complex interacting systems. Remotely sensed geodetic data products may be explored, compared with faults and landscape features, mined by pattern analysis applications, and integrated with models and pattern analysis applications in a rich Web-based and visualization environment. Integration of heterogeneous data products with pattern informatics tools enables efficient development of models. Federated database components and visualization tools allow rapid exploration of large datasets, while pattern informatics enables identification of subtle, but important, features in large data sets. QuakeSim is valuable for earthquake investigations and modeling in its current state, and also serves as a prototype and nucleus for broader systems under development. The framework provides access to physics-based simulation tools that model the earthquake cycle and related crustal deformation. Spaceborne GPS and Inter ferometric Synthetic Aperture (InSAR) data provide information on near-term crustal deformation, while paleoseismic geologic data provide longerterm information on earthquake fault processes. These data sources are integrated into QuakeSim's QuakeTables database system, and are accessible by users or various model applications. UAVSAR repeat pass interferometry data products are added to the QuakeTables database, and are available through a browseable map interface or Representational State Transfer (REST) interfaces. Model applications can retrieve data from Quake Tables, or from third-party GPS velocity data services; alternatively, users can manually input parameters into the models. Pattern analysis of GPS and seismicity data has proved useful for mid-term forecasting of earthquakes, and for detecting subtle changes in crustal deformation. The GPS time series analysis has also proved useful as a data-quality tool, enabling the discovery of station anomalies and data processing and distribution errors. Improved visualization tools enable more efficient data exploration and understanding. Tools provide flexibility to science users for exploring data in new ways through download links, but also facilitate standard, intuitive, and routine uses for science users and end users such as emergency responders.

Donnellan, Andrea↗

NASA NTRS2006

An Empirical Comparison between Two Recursive Filters for Attitude and Rate Estimation of Spinning Spacecraft

The advantages of inducing a constant spin rate on a spacecraft are well known. A variety of science missions have used this technique as a relatively low cost method for conducting science. Starting in the late 1970s, NASA focused on building spacecraft using 3-axis control as opposed to the single-axis control mentioned above. Considerable effort was expended toward sensor and control system development, as well as the development of ground systems to independently process the data. As a result, spinning spacecraft development and their resulting ground system development stagnated. In the 1990s, shrinking budgets made spinning spacecraft an attractive option for science. The attitude requirements for recent spinning spacecraft are more stringent and the ground systems must be enhanced in order to provide the necessary attitude estimation accuracy. Since spinning spacecraft (SC) typically have no gyroscopes for measuring attitude rate, any new estimator would need to rely on the spacecraft dynamics equations. One estimation technique that utilized the SC dynamics and has been used successfully in 3-axis gyro-less spacecraft ground systems is the pseudo-linear Kalman filter algorithm. Consequently, a pseudo-linear Kalman filter has been developed which directly estimates the spacecraft attitude quaternion and rate for a spinning SC. Recently, a filter using Markley variables was developed specifically for spinning spacecraft. The pseudo-linear Kalman filter has the advantage of being easier to implement but estimates the quaternion which, due to the relatively high spinning rate, changes rapidly for a spinning spacecraft. The Markley variable filter is more complicated to implement but, being based on the SC angular momentum, estimates parameters which vary slowly. This paper presents a comparison of the performance of these two filters. Monte-Carlo simulation runs will be presented which demonstrate the advantages and disadvantages of both filters.

Harman, Richard R.↗

NASA NTRS2018

Initial Operations Experience and Results from the Juno Gravity Experiment

Radio communications between the Juno spacecraft, in orbit around Jupiter, and the Earth-based observing stations of NASA’s Deep Space Network enable measurements of the Doppler shift induced on the radio signals by Juno’s motion in the Jovian environment. This measurement of the Doppler shift improves the knowledge of Jupiter’s gravitational field. As a radio science instrument, Juno’s gravity science instrument utilizes a ground component at the Deep Space Network’s DSS-25 antenna, equipped with simultaneous dual X- and Ka-band transmitters and receivers, and a spacecraft component, which includes X- and Ka-band transponders to relay the transmitted signal back to Earth. Originally planned to be in 14-day orbits around Jupiter, a risk identified in the propulsion system led to the decision to stay in the 53-day orbit period. Rapid turnaround of observation planning led to successful near-term perijove passes. Although maintaining a 53-day orbit period provides a scientific benefit to the gravity science investigation, the longer orbit period further increases the large dynamic range in Doppler shift and pointing angles induced by the geometry of each perijove. Between entering orbit at Jupiter on July 5, 2016 and September 2017, the Juno spacecraft has executed eight closest approach periods every 53 days where science data was collected. The first five perijove passes were conducted in different telecom configurations, each presenting unique challenges in data collection and processing. Perijoves PJ-01, PJ-02, PJ-03, and PJ-06 utilized the high-gain antenna and various configurations of the X- and Ka-bands. Perijoves PJ-04 and PJ-05 utilized the medium-gain antenna at X-band only while the spacecraft was off-Earth point. Additional perijoves are planned every 53-days, with an additional five by March 2018. Lessons learned from operating and collecting data at each perijove are documented and will be utilized in future perijoves. Analysis of the first two gravity science perijoves has improved the precision of Jupiter’s gravity field by a factor of five, providing crucial constraints on the interior structure of Jupiter.

Buccino, Dustin↗

NASA NTRSDate not supplied

Expanding Repository Data Available For Sharing and Knowledge Discovery

Some of the hardest space biology and space health challenges require data-intensive, bioinformatic, meta-analytical, and computer-assisted research approaches. These challenges include examining interdisciplinary space life science research across experiments and across interacting spaceflight hazards (radiation, altered gravity, confinement, hostile-closed environments, distance-duration from Earth). The approaches to confront these challenges involve mining multiple datasets simultaneously from various hierarchical organizations of biological complexity, all while concurrently evaluating how experimental design factors affect endpoints of standard assays. To enable this field, it is essential that principal investigators (PIs) submit data in a structure so it can be maximally re-used. The purpose of the NASA Ames Life Sciences Data Archive (ALSDA) is to collect, curate, and make publicly available all non-human space-relevant biological data. ALSDA must also ensure data are open-access, and maximally findable, accessible, interoperable, and reusable (FAIR). The scope of ALSDA data collected and submitted by PIs include subject and study design metadata, assay metadata parameters, raw and processed assay data, assay imagery/video, and subject-experienced mission data telemetry (radiation, temperature, humidity, acoustics, vibrations, etc.). ALSDA recently integrated into a collaborative group of Open Science projects to facilitate a suite of new tools and workflows that will improve data submission, accessibility, and reusability by implementing digital data submission agreements, and adopting the data management system originally developed by NASA GeneLab. ALSDA intends to bring current biological repository data and all future collected data into this new scientific data reuse reality. This new suite of tools will enable ALSDA to deploy a science curation system using scientific assay configurations for the data submission portal. It will capture essential assay parameters according to established standards in each sub-field within biology. The submission portal expedites data collection by enhancing ease of PI data submission, providing a user interface and specificity for which data is to be submitted. Data submissions can be brought into cutting-edge informatic analysis portals to enable mining of physiological, behavioral, biochemical, and imaging datasets in conjunction with ‘omics-level datasets. As ALSDA datasets are submitted, curated, and published (e.g., micro-computed tomography, histology, pulse oximetry, serum metabolites, magnetic resonance imaging, intraocular pressure, novel object recognition, etc.), the merging together of spaceflight data along this multi-hierarchical complexity of biology will enable informatics and data-intensive approaches resulting in knowledge discoveries across missions, space hazards, and biological disciplines.

Biology↗

NASA NTRSDate not supplied

Expanding Repository Data Available For Sharing And Knowledge Discovery

life science↗

NASA NTRS2008

The Cassini Live Update Process

The Cassini orbiter is an international science mission to the Saturnian system with 12 science instruments onboard. The Cassini spacecraft lacks a scan platform, which means the entire spacecraft must be rotated to control pointing of any one instrument's boresight. The resulting complex sequences of commands are built beginning many months before execution onboard. Late ephemeris updates from improved navigation data (i.e. after an orbital trim maneuver) often result in pointing commands in the sequence no longer being accurate enough to obtain the desired science observation. This paper will provide an overview of how Cassini uses live updates to address this potential loss of data, including the software developed for this process.

Vandermey, Nancy↗

NASA NTRS1999

A Versatile Planetary Radio Science Microreceiver

We have developed a low-power. programmable radio "microreceiver" that combines the functionality of two science instruments: a Relative Ionospheric Opacity Meter (riometer) and a swept-frequency, VTF/HF radio spectrometer. The radio receiver, calibration noise source, data acquisition and processing, and command and control functions are all contained on a single circuit board. This design is suitable for miniaturizing as a complete flight instrument. Several of the subsystems were implemented in a field-programmable gate array (FPGA), including the receiver detector, the control logic, and the data acquisition and processing blocks. Considerable efforts were made to reduce the power consumption of the instrument, and eliminate or minimize RF noise and spurious emissions generated by the receiver's digital circuitry. A prototype instrument was deployed at McMurdo Station, Antarctica, and operated in parallel with a traditional riometer instrument for approximately three weeks. The attached paper (accepted for publication by Radio Science) describes in detail the microreceiver theory of operation, performance specifications and test results.

Fry, Craig D.↗

NASA NTRS2022

Europa Clipper Payload Verification and Validation: Avionics-Instrument Interface Test Campaign

NASA's Europa Clipper mission will investigate Jupiter's icy moon Europa using a payload suite consisting of nine instruments to address a range of scientific objectives concerning Europa's habitability. As the project proceeds past its Critical Design Review, confidence is being built in the system's ability to achieve mission objectives through the implementation of a rigorous payload verification and validation (V&V) program. As part of this payload V&V program, instrument box-level testing was performed by the payload team to verify select instrument-avionics interface requirements. This testing was performed at JPL using the avionics testbed's Bulk Data Storage Emulator (BDSEM) with visiting instrument Test Models. This paper summarizes the Data Link test campaign involving roughly four days of functional testing per instrument, including planning, testing methods, types of issues found, and the requirement closure process. Detail is also provided on the development, deployment, and validation of a standardized analysis tool used in data reviews. This testing verified requirements related to commanding rates, loss of link, packet format, clock counters, loopback test capability, and SpaceWire jitter and skew margins. Additional risk reduction testing of basic commanding, counter behavior, science data collection and transfer, and interface swapping was also performed. Because the BDSEM venue was not originally designed to be a run for record venue, the process of characterizing venue fidelity and establishing suitability for requirement closure using data collected in this venue will also be addressed.In order to close requirements, an extensible tool was developed to post-process instrument command and telemetry data from their original binary to a human-readable format and give visibility to errors detected within the data, such as packets with Cyclic Redundancy Check errors. This tool, called payload-packet-parser, is a Python 3.9 command line tool built using a variety of open-source Python libraries. Payload-packet-parser was designed to support parsing command and telemetry packets for all Europa Clipper instruments and additional analysis tools were developed for verification of specific information interface requirements. This test campaign, including post-processing using a single parsing and verification toolset, allowed for early interface testing, alleviating testing burdens on instrument teams and buying down risk on the instrument-avionics interface by finding hardware and software issues and idiosyncrasies prior to integration with system test venues. Over twenty issues were discovered across the payload, resulting in software updates and instrument rework well in advance of any system impacts. This paper concludes with an assessment of benefits and costs of this type of testing and lessons learned.

Montanez, Leticia↗

NASA NTRSDate not supplied

NASA’s Earth System Observatory Formulation Progress

The 2017 Earth Science Decadal Survey by the National Academies of Science, Engineering, and Medicine identified five foundational observations, or Designated Observables (DO), to be implemented as missions by NASA. To address these five DO areas – Surface Biology and Geology; Mass Change; Aerosols; Cloud, Convection, and Precipitation; and Surface Deformation and Change – NASA is developing the Earth System Observatory (ESO) as an array of Earth-focused, interconnected satellite missions. The ESO will build on the strong history of international partnerships in NASA Earth science, with initial participation and collaboration on these missions across space agency partners including the Japanese Aerospace Exploration Agency (JAXA), Centre National D'Etudes Spatiales (CNES), Canadian Space Agency (CSA), Deutsches Zentrum für Luft- und Raumfahrt (DLR), and Agenzia Spaziale Italiana (ASI). Targeting launch dates in the late 2020s and early 2030s, the ESO will work as a single observatory, with each satellite in the ESO delivering its own valuable information, but taken together, the data and imagery will provide the global community with a multidimensional, holistic view of the Earth. In addition to furthering the world’s scientific knowledge, data gathered by ESO missions will provide actionable science to inform decisions related to climate change, disaster mitigation, and wildfires, improve real-time agricultural processes, and many other applications. This paper will provide an overview of the ESO development activities, as well as an update on the individual ESO missions currently in formulation – Atmosphere Observing System, Gravity Recovery and Climate Experiment-Continuity, and Surface Biology and Geology – including current mission architectures and concepts, international partner collaboration, science community engagement, and applications efforts, as well as how ESO data will be freely open and accessible to users all over the world.

NASA Earth Science↗

NASA NTRS2015

Intelligent Observation Strategies for Geosynchronous Remote Sensing for Natural Hazards

Geosynchronous satellites offer a unique perspective for monitoring environmental factors important to understanding natural hazards and supporting the disasters management life cycle, namely forecast, detection, response, recovery and mitigation. In the NASA decadal survey for Earth science, the GEO-CAPE mission was proposed to address coastal and air pollution events in geosynchronous orbit, complementing similar initiatives in Asia by the South Koreans and by ESA in Europe, thereby covering the northern hemisphere. In addition to analyzing the challenges of identifying instrument capabilities to meet the science requirements, and the implications of hosting the instrument payloads on commercial geosynchronous satellites, the GEO-CAPE mission design team conducted a short study to explore strategies to optimize the science return for the coastal imaging instrument. The study focused on intelligent scheduling strategies that took into account cloud avoidance techniques as well as onboard processing methods to reduce the data storage and transmission loads. This paper expands the findings of that study to address the use of intelligent scheduling techniques and near-real time data product acquisition of both the coastal water and air pollution events. The topics include the use of onboard processing to refine and execute schedules, to detect cloud contamination in observations, and to reduce data handling operations. Analysis of state of the art flight computing capabilities will be presented, along with an assessment of cloud detection algorithms and their performance characteristics. Tools developed to illustrate operational concepts will be described, including their applicability to environmental monitoring domains with an eye to the future. In the geostationary configuration, the payload becomes a networked thing with enough connectivity to exchange data seamlessly with users. This allows the full field of view to be sensed at very high rate under the control of ground infrastructure, resulting in improved efficiencies, accuracy and science benefits. Hence a remote sensing payload and its data may become one of millions of connected objects in the emerging Internet of Things (IoT), and be as easily accessible by a users smart phone as any other smart appliance.

0↗

NASA NTRS1986

Historical data retrieval study - Results for the first five years of KSC STS payload processing

This paper identifies general and specific quantitative and qualitative results from a study of actual operational experiences while processing 185 science, applications, and commercial payloads for the first five years of STS operations at NASA's Kennedy Space Center (KSC). All the non-DOD payloads from STS-2 through STS-33 were part of the study. The emphasis was placed on various program planning and events that affected KSC processing, payload experiences and improvements, payload hardware condition after arrival, services to customers, and the impact of STS operations and delays. From these initial considerations, operational drivers were identified, data for selected processing measurements collected and analyzed, processing criteria and options determined, and STS payload results and conclusions reached. The study showed a significant reduction in time and effort needed by STS customers and KSC to process a wide variety of payload configurations, although even the simplest payloads required more processing resources and time than were initially assumed.

Ragusa, J. M.↗

NASA NTRS2003

Validating the Autonomous Science Agent

This paper describes the validation process for the Autonomous Science Agent, a software agent that will fly onboard the EO-1 spacecraft from 2003-2004. This agent will recognize science events, retarget the spacecraft to respond to the science events, and reduce data downlink to only the highest value science data. The autonomous science agent has been designed using a layered architectural approach with specific redundant safeguards to reduce the risk of an agent malfunction to the EO-1 spacecraft. This 'safe' design is also in the process of being thoroughly validated by informal validation methods and extensive testing. This paper describes the analysis used to define agent safety, elements of the design that increase the safety of the agent, and the process being used to validate agent safety prior to the agent software controlling the spacecraft.

agent safety↗

NASA NTRS1988

An expert system for satellite and instrument data anomaly and fault isolation

A prototype Generic Payload Operations Control System (GPOCC) is being developed at the NASA Jet Propulsion Laboratory to provide a low-cost command and control processing center for science instruments and small payloads. The GPOCC supports the difficult transition from integration and test to flight operations. The prototype will incorporate four expert systems to perform telemetry, command, and mission planning functions as well as telecommunications scheduling. The first of these expert systems to be developed will perform telemetry data analysis and fault isolation, as well as propose corrective action. This Data Analysis Module (DAM) will monitor telemetry data and perform continual data monitoring and trend analysis based on a knowledge base and historic data archived on an optical disk storage device. The system maintains a continuous knowledge database of past system performance characteristics. The goal of the Data Analysis Module is to achieve consistent, dependable and validatable performance, to demonstrate thorough, reliable and fast reasoning, and to reduce the concentration demanded of flight analysis personnel.

Busse, Carl↗

NASA NTRS2004

Space-based Science Operations Grid Prototype

Grid technology is the up and coming technology that is enabling widely disparate services to be offered to users that is very economical, easy to use and not available on a wide basis. Under the Grid concept disparate organizations generally defined as "virtual organizations" can share services i.e. sharing discipline specific computer applications, required to accomplish the specific scientific and engineering organizational goals and objectives. Grids are emerging as the new technology of the future. Grid technology has been enabled by the evolution of increasingly high speed networking. Without the evolution of high speed networking Grid technology would not have emerged. NASA/Marshall Space Flight Center's (MSFC) Flight Projects Directorate, Ground Systems Department is developing a Space-based Science Operations Grid prototype to provide to scientists and engineers the tools necessary to operate space-based science payloads/experiments and for scientists to conduct public and educational outreach. In addition Grid technology can provide new services not currently available to users. These services include mission voice and video, application sharing, telemetry management and display, payload and experiment commanding, data mining, high order data processing, discipline specific application sharing and data storage, all from a single grid portal. The Prototype will provide most of these services in a first step demonstration of integrated Grid and space-based science operations technologies. It will initially be based on the International Space Station science operational services located at the Payload Operations Integration Center at MSFC, but can be applied to many NASA projects including free flying satellites and future projects. The Prototype will use the Internet2 Abilene Research and Education Network that is currently a 10 Gb backbone network to reach the University of Alabama at Huntsville and several other, as yet unidentified, Space Station based science experimenters. There is an international aspect to the Grid involving the America's Pathway (AMPath) network, the Chilean REUNA Research and Education Network and the University of Chile in Santiago that will further demonstrate how extensive these services can be used. From the user's perspective, the Prototype will provide a single interface and logon to these varied services without the complexity of knowing the where's and how's of each service. There is a separate and deliberate emphasis on security. Security will be addressed by specifically outlining the different approaches and tools used. Grid technology, unlike the Internet, is being designed with security in mind. In addition we will show the locations, configurations and network paths associated with each service and virtual organization. We will discuss the separate virtual organizations that we define for the varied user communities. These will include certain, as yet undetermined, space-based science functions and/or processes and will include specific virtual organizations required for public and educational outreach and science and engineering collaboration. We will also discuss the Grid Prototype performance and the potential for further Grid applications both space-based and ground based projects and processes. In this paper and presentation we will detail each service and how they are integrated using Grid

Bradford, Robert N.↗

NASA NTRS1994

OOD/OOP experience in the Science Operations Center part of the ground system for X ray Timing Explorer mission

The Science Operations Center (SOC) for the X-ray Timing Explorer (XTE) mission is an important component of the XTE ground system. Its mandate includes: (1) command and telemetry for the three XTE instruments, using CCSDS standards; (2) monitoring of the real-time science operations, reconfiguration of the experiment and the instruments, and real-time commanding to address the targets of opportunity (TOO) and alternate observations; and (3) analysis, processing, and archival of the XTE telemetry, and the timely delivery of the data products to the principal investigator (PI) teams and the guest observers (GO). The SOC has two major components: the science operations facility (SOF) that addresses the first two objectives stated above and the guest observer facility (GOF) that addresses the third. The SOF has subscribed to the object oriented design and implementation; while the GOF uses the traditional approach in order to take advantage of the existing software developed in support of previous missions. This paper details the SOF development using the object oriented design (OOD), and its implementation using the object oriented programming (OOP) in C++ under Unix environment on client-server architecture using Sun workstations. It also illustrates how the object oriented (OO) and the traditional approaches coexist in SOF and GOF, the lessons learned, and how the OOD facilitated the distributed software development collaboratively by four different teams. Details are presented for the SOF system, its major subsystems, its interfaces with the rest of the XTE ground data system, and its design and implementation approaches.

Choudhary, Abdur Rahim↗

NASA NTRS2023

Pypromice: A Python Package for Processing Automated Weather Station Data

The pypromice Python package is for processing and handling observation datasets from automated weather stations (AWS). It is primarily aimed at users of AWS data from the Geological Survey of Denmark and Greenland (GEUS), which collects and distributes in situ weather station observations to the cryospheric science research community. Functionality in pypromice is primarily handled using two key open-source Python packages, xarray (Hoyer & Hamman, 2017) and pandas (The pandas development team, 2020). A defined processing workflow is included in pypromice for transforming original AWS observations (Level 0, L0) to a usable, CF-convention-compliant dataset (Level 3, L3) (Figure 1). Intermediary processing levels (L1,L2) refer to key stages in the workflow, namely the conversion of variables to physical measurements and variable filtering (L1), cross-variable corrections and user-defined data flagging and fixing (L2), and derived variables (L3). Information regarding the station configuration is needed to perform the processing, such as instrument calibration coefficients and station type (one-boom tripod or two-boom mast station design, for example), which are held in a toml configuration file. Two example configuration files are provided with pypromice , which are also used in the package’s unit tests. More detailed documentation of the AWS design, instrumentation, and processing steps are described in Fausto et al. (2021).

pypromice↗