LT World

You are here: Home kb Information & Knowledge Technologies Modality Integration: Facial Movement and Speech

Modality Integration: Facial Movement and Speech



  • Norbert Reithinger
  • Ralf Engel

  • COnversational Multimodal Interaction with Computers (COMIC)
  • Multidimensional Information Access using Multiple Modalities (MIAMM)
  • SmartKom

Multimodal fusion combines the output of speech understanding, gestures and mimic recognition (if available) to an uniform representation of the user intention.