spotify/luigi

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

语言：Python · GitHub 星标：18,781 · Fork：2,474

话题：hadoop · luigi · orchestration-framework · python · scheduling

在 GitHub 上查看原仓库