New York City Taxi and Limousine Commission (TLC) Trip Record Data

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/nyc-tlc-trip-records-pds-dataset")

fs.listdir("s3://nyc-tlc")

Description:

Data of trips taken by taxis and for-hire vehicles in New York City. Note: access to this dataset is free, however direct S3 access does require an AWS account. Anonymous downloads are accessible from the dataset's documentation webpage listed below.

Contact:

Data of trips taken by taxis and for-hire vehicles in New York City. Note: access to this dataset is free, however direct S3 access does require an AWS account. Anonymous downloads are accessible from the dataset's documentation webpage listed below.

Update Frequency:

As soon as new data is available to be shared publicly.

Managed By:

City of New York Taxi and Limousine Commission

Resources:

1. resource:
   • Description: PARQUET files containing NYC TLC trip data.
   • ARN: arn:aws:s3:::nyc-tlc
   • Region: us-east-1
   • Type: S3 Bucket
   • AccountRequired: True

Tags:

aws-pds, cities, urban, transportation

Tutorials:

1. tutorial:

   • Title: Machine learning on distributed Dask using Amazon SageMaker and AWS Fargate
   • URL: https://aws.amazon.com/blogs/machine-learning/machine-learning-on-distributed-dask-using-amazon-sagemaker-and-aws-fargate/
   • AuthorName: Ram Vittal

2. tutorial:

   • Title: Build and run streaming applications with Apache Flink and Amazon Kinesis Data Analytics for Java Applications
   • URL: https://aws.amazon.com/blogs/big-data/build-and-run-streaming-applications-with-apache-flink-and-amazon-kinesis-data-analytics-for-java-applications/
   • AuthorName: Steffen Hausmann

3. tutorial:

   • Title: Deep Dive on Flink & Spark on Amazon EMR
   • URL: https://www.youtube.com/watch?v=MzTZp47Jy7E
   • AuthorName: Keith Steward

4. tutorial:

   • Title: Build a Real-time Stream Processing Pipeline with Apache Flink on AWS
   • URL: https://aws.amazon.com/blogs/big-data/build-a-real-time-stream-processing-pipeline-with-apache-flink-on-aws/
   • AuthorName: Steffen Hausmann

5. tutorial:

   • Title: Exploring data with Python and Amazon S3 Select
   • URL: https://github.com/aws-samples/cloud-experiments/tree/master/experiments/notebooks/exploring-data
   • AuthorName: Manav Sehgal

6. tutorial:

   • Title: Optimizing data for analysis with Amazon Athena and AWS Glue
   • URL: https://github.com/aws-samples/cloud-experiments/tree/master/experiments/notebooks/optimizing-data
   • AuthorName: Manav Sehgal