BdLexicon Dataset
The bdLexicon corpus is a structured dataset consisting of Bengali words along with their corresponding lexical information. Each entry in the corpus includes a word and its associated bdLexicon entry, encapsulating various senses, parts of speech, lemma forms, examples, synonyms, and translations. The bdLexicon corpus is vital for advancing Bengali language processing tasks. It facilitates accurate word sense disambiguation, semantic analysis, and machine translation, aiding the development of tailored language models.
Data Cardinality
| Type | Count |
|---|---|
| number of words | 954 |
| number of senses | 1045 |
| number of synonym | 4202 |
| average number of senses per word | 1.1 |
| average number of synonyms per senses | 4 |
- noun 59.8499
- adjective 31.9887
- adverb 3.7523
- verb 3.1895
- conjunction 0.1876
- post_position 0.1876
- interjection 0.1876
- pronoun 0.6567
Metadata
Annotated data is delivered in CSV format, containing annotations for BdLexicon. Each field in the dataset is precisely described to ensure clarity and ease of understanding.
| Column Name | Description | Example |
|---|---|---|
| word | Words of the dataset | চলাফেরা |
| bdlexicon | Lexical information such as sense, POS, lemma, synonyms of the word along with examples and translations. |
The lexical information of the json is described below
- sense Meaning of the word in a specific context
- list_of_pos Different parts-of-speech tags of the word in different contexts
- pos Parts-of-speech tag of the word in a specific context
- lemma Lemma of the word
- examples Usage of the word in different sentences in corresponding sense
- synonyms Bengali synonyms of the word in corresponding sense
- translation Translated words (English) in corresponding sense