uber/petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

语言：Python · GitHub 星标：1,895 · Fork：285

话题：deep-learning · machine-learning · parquet · parquet-files · pyarrow · pyspark · pytorch · sysml

在 GitHub 上查看原仓库