Anudesh v2.0

1. New project types for evaluating multiple model outputs:

• ModelOutputEvaluation - Evaluate the responses for a given prompt-output pair.
• ModelInteractionEvaluation - Evaluate the responses for multiple prompt-output pairs.
• MultipleInteractionEvaluation - Evaluate the responses from multiple models for a single prompt.
• MultipleLLMInstructionDrivenChat - Chat real-time with multiple LLMs and evaluate the responses

2. Support for more LLMs.
3. Voice-based input for Indic languages through IndicASR model integration.
4. Redesigned Chat page with support for image upload.
5. Logging of users' chats.
6. New Task Assignment Features.
7. Auto task assignment to guest users.
8. Preferential task assignment for reviewers based on either the annotators or the task IDs or a filter criteria.
9. Support for multiple annotators to work on each task.
10. Bulk add users to projects.
11. Bookmarking of projects by users.

Anudesh v1.0 06.09.2024

Introducing Anudesh - An LLM Data annotation platform created with a vision to support development and evaluation of LLMs.

Anudesh v1.0 06.09.2024 offers many unique features:

• Multilingual support.
• Flexible Integration with any LLM API.
• Organizational management made easy.
• Powerful and clean user interface.
• Comprehensive reports and analytics.
• Invite based user onboarding for private data annotation.
• Guest user login for public crowdsourced data annotation.
• Integration with transliteration package.
• Stable backend based on Shoonya-Backend architecture