Improve reviews language detection
in progress
Anatoly Sharifulin
in progress
Anatoly Sharifulin
Merged in a post:
Enhance Language Detection for Short Reviews and Transliteration Cases
G
Grateful Salmon
Customers have reported inaccuracies in the language detection of reviews, particularly in the following scenarios:
- Short reviews (less than 2 words): The language detection accuracy is low, and no language is assigned in these cases.
- Medium-length reviews (3–5 words): Misclassifications occur more frequently due to limited context.
- Reviews with transliterations: Mixed-language text can cause incorrect language identification.
Impact:
These issues affect the reliability of review analysis and create challenges for customers relying on accurate language detection for categorization, tagging, and responding.
Additional Context:
This request stems from specific customer feedback, highlighting cases where the word "bien" was detected as French instead of Spanish. Similar instances have been reported across other languages as well.
Anatoly Sharifulin
planned
Anatoly Sharifulin
under review
D
Due Capybara
Improve review language detection as we had three English reviews with the wrong language detected in one week. It affects the language used for AI auto-reply.