Pandas and S3 in 1 liner
- bdata3
- Apr 23, 2020
- 1 min read
You have a gzip (or other) file on S3 and you want it in dataframe:
import pandas as pd import boto3 df = pd.read_csv('s3://bucket/file.csv.gz',compression='gzip',sep='\t',encoding = "ISO-8859-1",nrows=3)

Comments