helgeho/ArchiveSpark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

语言：Scala · GitHub 星标：164 · Fork：19

话题：archivespark · internet-archive · spark · spark-framework · warc · web-archiving · webarchive

在 GitHub 上查看原仓库