RBSP/RPS/README

From ViRBO

Jump to: navigation, search
Relativistic Proton Spectrometer (RPS) Data README

Contents

  1. Data Levels
  2. Sensor Response Files
  3. Data Versioning
  4. Archive Structure
  5. Release Notes for Level 4 Files
    1. Version 3.0
  6. Release Notes for Level 3 Files
    1. Version 3.0
  7. Release Notes for Level 2 Files
    1. Version 3.0
    2. Version 1.2
    3. Version 1.1
    4. Version 1.0
    5. Version 0.5
    6. Version 0.4
  8. Release Notes for Level 1 Files
    1. Version 3.0
    2. Version 1.2
    3. Version 1.1
    4. Version 1.0
    5. Version 0.8
    6. Version 0.7
  9. Release Notes for Level 0 Files
    1. Version 3.0
    2. Version 2.1
    3. Version 2.0
    4. Version 1.0
    5. Version 0.3
    6. Version 0.2
    7. Version 0.1
    8. Version 0.0


1. Data Levels

RPS data is delievered in 5 levels

  • Level 0 - raw instrument packet data rbspa_L0-2c1-rh_psbr-rps_20121001_v3.0.0.cdf or rbspa_L0-2c2-de_psbr-rps_20121001_v3.0.0.cdf
    • Time is expressed in Mission Elapsed Time (MET) not UTC
      • MET is approximately seconds since 00:00 UTC on 1 Jan 2010
      • Each file contains one mission day (not exactly a UTC day) approximated by the UTC day of the file name in YYYYMMD format (older versions of filenames used the 4-digit mission day)
      • Mission Day 1 is 30 Aug 2012
    • Files with APID 2c1 are 1-second rate and housekeeping data (metadata)
    • Files with APID 2c2 are direct event data, at most one packet per second, potentially multiple events per packet (metadata)
  • Level 1 - Conversion to physical units rbspa_L1_psbr-rps_20121001_v3.0.0.cdf metadata
    • Each file is one UTC day, given in YYYYMMDD format in the file name
    • Contains 1-second rate and housekeeping data (depends on Epoch)
    • Contains 1-second rates in each data channel (approximately an energy/species channel)
    • Contains high rate event data (depends on EVENT_Epoch and variables with names EVENT_*)
    • Contains estimated energy and other event characteristics
  • Level 2 - Flux versus energy versus time, two file types
  • Level 3 - Flux versus energy and pitch angle versus time rbspa_L3_psbr-rps_20121001_v3.0.0.cdf metadata
    • Each file is one UTC day, given in YYYYMMDD format in the file name
    • Contains multiple flux vs angle for different coordinate angle coordinates (E.g., spin sector, local pitch angle, equatorial pitch angle)
    • One minute averages in each angle bin
  • Level 4 - Flux versus invariants, two file types

2. Sensor Response Files

Sensor response files are also provided README

  • Response to isotropic protons csv
  • Response to isotropic electrons csv
  • Energy-angle response hdf5 cdf
  • Report: ATR-2021-02018 - Relativistic Proton Spectrometer Flux Determination and Data Products pdf
  • Report: ATR-2021-02025 - Relativistic Proton Spectrometer Detector Calibration pdf
  • Report: ATR-2021-02026 - Relativistic Proton Spectrometer Electron Response pdf

3. Data Versioning

All RPS data products carry a version number of the form vX.Y.Z. Different parts of the version name will be updated depending on what has changed:

  • X - The file contents have changed: variables added, deleted, renamed, resized, retyped
  • Y - The processing algorithms have changed in a way deemed significant
  • Z - New data has been added, minor changes to the processing algorithms, changes to the metadata

All version 0.Y.Z data is preliminary, as it represents an evolving data processing system. Prior to version 1.0.0, activities that would normally increment the X part of the version number will only increment Y. Therefore, level 0.1.Z and 0.2.0 may contain different variables, etc, whereas normally such a change would promote version 1.Y.Z to version 2.0.0

4. Archive Structure

For Level 0 data, the ptp file format is the official definitive record. For Level 1 and higher products, the CDF file format is the official definitive record.

Also, Level 0 ptp data is not broken out by year, whereas all other Level 0 and and higher products are.

In terms of archiving -- at most only the latest X.Y version of a file is retained (e.g., v1.0.1 retained but v1.0.0 deleted). When fluxes are not changed, the latest X version may only be retained (e.g., v1.1.0 retained, but v1.0.0 deleted).

5. Release Notes for Level 4 Files

5.1. Version 3.0

  • Initial version and post-mission archive

6. Release Notes for Level 3 Files

6.1. Version 3.0

  • Initial version and post-mission archive

7. Release Notes for Level 2 Files

7.1. Version 3.0

  • Post-mission archive
  • Final corrections to metadata
  • Final temperature and drift corrections applied
  • RPS-A D9 recovery applied
  • Improved total dose and dose rate calculation
  • Updated metadata to improve ISTP compliance

7.2. Version 1.2

  • Correction: seconds with no direct events now have zero flux rather than fill
  • Inherited L1 v1.2 timing correction on pitch angle determination
  • On 10 Jan 2018, we began reprocessing all Level 2 (L2) v1.2 files to fix the length of the SPIN_OMEGA variable. In earlier v1.2 files, it had unit length, but in the reprocessed files it has the advertised length: the spin rate in rad/s. As this is a change to a minor variable, we are not incrementing from v1.2 to v1.3. The Level 1 (L1) SPIN_OMEGA variables were correct, and so those files are not being reprocessed. This change only affects L2 files.

7.3. Version 1.1

  • Inherited background removal from L1 v1.1: Applied background removal for EVENT_DIRECTION=1 and EVENT_TYPE neither PEN(1) or CHE(2)

7.4. Version 1.0

  • Changed to byVar compression
  • Minor changes to metadata
  • After the initial v1.0.0 run, a missing factor of 2pi was discovered in the PHI (3rd invariant) calculation. That is corrected in all files generated after 1/1/2017.
  • Note that After 8 Jan 2016, the RPS-A instrument does not produce any fluxes with our current algorithms due to the failure of the Cherenkov subsystem. A new algorithm is pending.

7.5. Version 0.5

  • Changed metadata

7.6. Version 0.4

  • Improved metadata, ISTP compliant

8. Release Notes for Level 1 Files

8.1. Version 3.0

  • Post-mission archive
  • ISTP naming convention
  • Final temperature and drift corrections applied
  • Added enable mask check
  • Updated metadata to improve ISTP compliance
  • File names updated to ISTP convention

8.2. Version 1.2

  • Corrected half-second offset in pitch angle interpolation

8.3. Version 1.1

  • Applied background removal for EVENT_DIRECTION=1 and EVENT_TYPE neither PEN(1) or CHE(2)

8.4. Version 1.0

  • Declared v1.0 after additional testing and patching for bad/missing files

8.5. Version 0.8

  • Changed metadata

8.6. Version 0.7

  • Improved metadata, nearly ISTP compliant
  • Renamed DEADTIME_SECONDS to DEADTIME_FRACTION
  • Added flag bit 8 for missing DE packet
  • Set PACKET_NUM_SLOTS=0 when PEN_RATE=CHE_RATE=0 and no DE packet

9. Release Notes for Level 0 Files

9.1. Version 3.0

  • Post-mission archive
  • File names updated to ISTP convention
  • Updated metadata to improve ISTP compliance

9.2. Version 2.1

  • Changed metadata

9.3. Version 2.0

  • Renamed variable DEADTIME_SECONDS to DEADTIME_FRACTION
  • Improved metadata

9.4. Version 1.0

  • Further improved structure of DE files
  • Improved metadata
  • Enabled compression in CDFs

9.5. Version 0.3

  • Corrected structure of DE files to have both time series and event series data
  • Added some default metadata

9.6. Version 0.2

  • Recovered some missing packets at end of MET day (affects ascii only)
  • Corrected combined enable mask

9.7. Version 0.1

  • Changed LIVE* to DEAD*, as in LIVETIME to DEADTIME.
  • Populated more global attributes.

9.8. Version 0.0

  • Very experimental. Used to verify data processing and publication chain
Personal tools