Skip to content

rpki-repo-archive.md

Latest commit

 

History

History
126 lines (77 loc) · 3.69 KB

rpki-repo-archive.md

File metadata and controls

126 lines (77 loc) · 3.69 KB

RPKI repository archive

The RPKI repository archive is at https://ftp.ripe.net/rpki/

The archive is structured as follows:

   https://ftp.ripe.net/rpki/TAL/YYYY/MM/DD/

with:

  • TAL : Trust anchor [1]
  • YYYY : Year
  • MM : Month
  • DD : Day

The individual daily directories per trust anchor contain 2 files:

  • repo.tar.xz: The raw repository content (as a tar-gzipped archive)
  • roas.csv.xz: The VRPs (Verified ROA Payloads) that were extacted from the PKI materials

A description of data issues from a researchers perspective is available at rpki-study.github.io

Changelog

Dates are the date of the change in the processing. They are likely reflected started in the file that starts on the next day.

2024-01-25:

  • Use routinator v0.13.1
  • After user feedback, we have unified the compression method used. The archive of historic roa.csv files was compressed as .xz as well. The repo.tar.gz archives have been recompressed as repo.tar.xz.

2023-10-11:

  • Added JSON output (output.json.xz)

Changed:

  • Compressed version of roa.csv added (roa.csv.xz)
  • XZ compressed version of repo.tar.gz added (repo.tar.xz)

2023-10-10:

  • Routinator updated to 0.13.0
  • Enabled ASPA (draft-ietf-sidrops-aspa-profile-16 support) on routinator

2023-07-19:

  • Routinator updated from 0.11.3 to 0.12.1

2023-07-18:

  • Failure to produce archives between 2023-07-14 and 2023-07-17 (including). These archives will remain missing. Service is restored on 2023-07-18.

2023-06-24:

  • No archives were created on 24-6-2023. This archive will remain missing.

2023-06-05:

  • Fix unit of IPv6 address space in ROAs on certification-stats. The data was always in /48s, but historically displayed as /32s.

2022-07-19:

  • Generate md5 and sha256 hashes so that downloads can be verified.

2022-04-12:

  • Re-uploaded all archives between 2022-02-18 and 2022-04-05 (including) to correct a 32-byte prefix in files in the unvalidated paths of the archives.

Resolves: 32-byte prefix in the historic archives.

2022-04-06:

  • Routinator updated from 0.10.1 to 0.11.1-rc1

Resolves: 32-byte prefix on files in the unvalidated paths of the archives from this day on.

2022-02-23:

  • routinator.log now contains errors + verbose output.
    • steps we execute changed: routinator update, routinator vrps --no-update, routinator dump
  • Trust Anchor certificate added to the archive (directly for now)

Resolves: trust anchor certificates are included in the dataset. Resolves: large fraction of days with partial data for APNIC

2022-02-18:

  • rrdp is enabled. This should resolve the updates containing only partial data for APNIC.
  • routinator.log containing errors in routinator output was added.

Artifact: change in directory structure of output (RRDP hostnames are present in repo.tar.gz archive). Known issue: trust anchor certificates are not present in output (and may have been for a while)

2022-02-15:

The containers running the data collection job have IPv6 connectivity

2021-10-01 (approximate):

Data collection switched from rpki-validator-2 to routinator 0.10.1.

  • routinator starts with a clean cache every day.
  • rrdp is not enabled (similar to rpki-validator-2).
  • The container running the job does not have IPv6 connectivity.

Known issue: A large fraction of the days has partial data for APNIC.

< 2021-10-01:

  • rpki-validator 2 was used
  • The roa.csv file is missing from a large number of repos.