MultiCoNER Dataset

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/multiconer-dataset")

fs.listdir("s3://multiconer")

Description:

MultiCoNER is a large multilingual dataset (11 languages) for Named Entity Recognition. It is designed to represent some of the contemporary challenges in NER, including low-context scenarios (short and uncased text), syntactically complex entities such as movie titles, and long-tail entity distributions.

Contact:

MultiCoNER is a large multilingual dataset (11 languages) for Named Entity Recognition. It is designed to represent some of the contemporary challenges in NER, including low-context scenarios (short and uncased text), syntactically complex entities such as movie titles, and long-tail entity distributions.

Managed By:

https://www.amazon.com/

Resources:

1. resource:
   • Description: Data files
   • ARN: arn:aws:s3:::multiconer
   • Region: us-west-2
   • Type: S3 Bucket

Tags:

natural language processing

Publication:

1. publication:

   • Title: GEMNET: Effective Gated Gazetteer Representations for Recognizing Complex Entities in Low-context Input
   • URL: https://www.amazon.science/publications/gemnet-effective-gated-gazetteer-representations-for-recognizing-complex-entities-in-low-context-input
   • AuthorName: Tao Meng, Anjie Fang, Oleg Rokhlenko and Shervin Malmasi

2. publication:

   • Title: Gazetteer Enhanced Named Entity Recognition for Code-Mixed Web Queries
   • URL: https://www.amazon.science/publications/gazetteer-enhanced-named-entity-recognition-for-code-mixed-web-queries
   • AuthorName: Besnik Fetahu, Anjie Fang, Oleg Rokhlenko and Shervin Malmasi

3. publication:

   • Title: Dynamic Gazetteer Integration in Multilingual Models for Cross-Lingual and Cross-Domain Named Entity Recognition
   • URL: https://assets.amazon.science/95/4c/47c2afd44236ac1a05d184e7813e/dynamic-gazetteer-integration-in-multilingual-models-for-cross-lingual-and-cross-domain-named-entity-recognition.pdf
   • AuthorName: Besnik Fetahu, Anjie Fang, Oleg Rokhlenko and Shervin Malmasi