Skip to main content

Multi-Modal Understanding

Multi-Modal Understanding is the capability to process, analyze, and comprehend information from multiple types of data sources simultaneously.

Overview​

Multi-Modal Understanding enables systems to:

  • Combine different data types
  • Cross-reference information
  • Extract unified meaning
  • Handle mixed-media content

Applications​

  • Visual question answering
  • Multi-modal search
  • Mixed-media analysis
  • Cross-modal retrieval