Multimodal interaction

1.

Subject title

Multimodal interaction

Мултимодална интеракција

2.

Code

m23_s_023

3.

Study program

Cloud Computing, Data science in computer science and engineering, IT management, Bioinformatics, Security, Cryptography and Coding, Еducation with ICT, Eco-informatics, Computer Science, Statistics and Data Analytics, Software for embedded systems, Cloud Computing, IT management, Bioinformatics, Security, Cryptography and Coding, Statistics and Data Analytics, Internet Technologies and cyber security, Inteligent Systems, Software Engineering, Software Engineering,

4.

Organizer of the study program (unit, institute, department, division)

Faculty of Information Sciences and Computer Engineering

5.

Study cycle (first, second, third)

Втор циклус

6.

Academic year / semester

5 / Летен

7. Number of ECTS credits

6.0

8.

Instructor

ворн. проф. д-р Катарина Тројачанец Динева проф. д-р Сузана Лошковска

9.

Prerequisites for enrollment

10.

Subject goals and competencies:

People use different senses and systems for mutual communication, simultaneous (face -to -face conversation) or alternatively (using speech, writing, gestures, touch). Traditionally communicating with computers was carried out through the keyboard and mouse and the computer was most often suited with visual stimuli in the form of text or images. The purpose of the course is to introduce students in new ways of interacting with computer systems that allow for better experience or efficiency of interaction with them (sound control, sound interaction, gesture recognition, touch screens, tatal interfaces, upgraded reality).

11.

Subject content:

Design of multimodal interaction. Design, modeling and analyzing multimodal input devices that include: Recognizing speech, recognizing and tracking traits and expressions of the human face, gesture recognition, touch -free interceptions, passage phones sensors and smart environments. Multimodal output devices that include: speech synthesis, sound object intercalists, tactile interfaces. Upgraded reality. Automatic analysis of multimodal behavior.

12.

Learning methods:

Предавања поддржани со презентации преку слајдови, интерактивни предавања, вежби (користење на опрема и софтверски пакети), тимска работа, пример случаи, поканети гости предавачи, самостојна изработка и одбрана на проектна задача и семинарска работа, учење во електронско опкружување (форуми, консултации).

13.

Total available time fund

6.0 ECTS x 30 hours = 180 hours

14.

Time distribution

60 + 0 + 45 + 45 + 30 = 180 hours

15.

Forms of teaching activities

15.1.

Lectures - theoretical teaching

60 hours

15.2.

Exercises (laboratory, classroom), seminars, team work

0 hours

16.

Other forms of activities

16.1.

Project tasks

45 hours

16.2.

Independent tasks

45 hours

16.3.

Homework

30 hours

17.

Grading method

17.1.

Tests

15 points

17.2.

Seminar work / project (presentation: written and oral)

45 points

17.3.

Activities and learning

15 points

17.4.

Final exam

0 points

18.

Grading criteria (points / grade)

up to 50 points

5 (five) (F)

from 51 to 60 points

6 (six) (E)

from 61 to 70 points

7 (seven) (D)

from 71 to 80 points

8 (eight) (C)

from 81 to 90 points

9 (nine) (B)

from 91 to 100 points

10 (ten) (A)

19.

Condition for signature and taking final exam

реализирани активности

20.

Language of instruction

македонски и англиски

21.

Quality assurance method

механизам на интерна евалуација и анкети

22.

Literature

22.1.

Mandatory literature

22.2.

Additional literature