Japanese Tokenizer Dictionaries

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/cotonoha-dic-dataset")

fs.listdir("s3://cotonoha-dic")

Description:

Japanese Tokenizer Dictionaries for use with MeCab.

Contact:

Japanese Tokenizer Dictionaries for use with MeCab.

Update Frequency:

Infrequently (typically less than once a year)

Managed By:

Cotonoha

Resources:

1. resource:
   • Description: Dictionary Files
   • ARN: arn:aws:s3:::cotonoha-dic
   • Region: ap-northeast-1
   • Type: S3 Bucket

Tags:

aws-pds, natural language processing, csv, japanese

Tutorials:

1. tutorial:
   • Title: Fugashi Word Count Tutorial
   • URL: https://github.com/polm/fugashi-sagemaker-demo/blob/master/fugashi%20wordcount.ipynb
   • AuthorName: Paul O'Leary McCann
   • AuthorURL: https://cotonoha.io
   • Services: SageMaker

Tools & Applications:

1. tools & applications:
   • Title: unidic-py
   • URL: https://github.com/polm/unidic-py
   • AuthorName: Paul O'Leary McCann
   • AuthorURL: https://cotonoha.io

Publication:

1. publication:
   • Title: How to Tokenize Japanese in Python
   • URL: https://www.dampfkraft.com/nlp/how-to-tokenize-japanese.html
   • AuthorName: Paul O'Leary McCann
   • AuthorURL: https://dampfkraft.com