redapt/pyspark-s3-parquet-example

This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apache Spark instance running on AWS EMR, which will run a SQLContext to create a temporary table using a DataFrame. SQL queries will then be possible against the temporary table.

语言：Python · GitHub 星标：19 · Fork：6

在 GitHub 上查看原仓库