Víkonnekt develops auto-scoring for CaptINI's AI-based Icelandic conversation app

One of the major hurdles to speaking an additional language is self-consciousness. The CaptINI platform offers a selection of curated topics and lessons that allow users to practice speaking with a pre-trained AI model. That means they can flex their Icelandic muscles without fear of judgment or 'being imperfect'.

The system provides users with corrective feedback—how they can adjust their pronunciation and grammar to make their speech more clear and correct. Víkonnekt is currently developing a method for automatic pronunciation scoring, which will provide users with immediate feedback.

Technologies used:

A data scientist developed CaptINI's pronunciation modules using NLP and other technologies for speech processing and recognition.

Vikonnekt helped in the development of the learning platform by handling everything from  front-end design to back-end functionalities.

Our startup collaborated closely with the research data scientist team to integrate their scoring and feedback models into the platform.

Frontend: Angular 13
Backend: Django
Docker
postgres

Automatic language switch:

By clicking in the flags provided in the header or the footer of the pages, users can seamlessly toggle the user interface between Icelandic and English without losing their progress.

Learning:

Topics list:

  • Users can easily search and filter topics to see their progress in each; each topic has its own unique 'progress bar'.
  • Users can filter lessons by topic to dive right back in where they left off, or to check how far they've progressed in each lesson.

Lesson list:

  • the same as for the topics the user get the list of lessons for each topic and can filter them or check his progress.

Exercice:

  • Each exercise within each lesson is equipped with a pre-recorded pronunciation sample, which the user can play automatically by pressing play.
  • Then, having the right information, the user records the way they say it; they can share this with the CaptINI community for feedback if they wish, but they always receive a score from the AI model to help them adjust.
Read more success stories