2021 BRN Discussion, page-2582

http://www.technologyreview.com/2021/02/24/1018085/multimodal-ai-vision-language/?truid=f8d1a051d7cb8339189d60eb692bc516&utm_source=the_download&utm_medium=email&utm_campaign=the_download.unpaid.engagement&utm_term=&utm_content=03-20-2021&mc_cid=f1e3644b4e&mc_eid=b80386bb05
"

AI armed with multiple senses could gain more flexible intelligence

In late 2012, AI scientists first figured out how to get neural networks to “see.” They proved that software designed to loosely mimic the human brain could dramatically improve existing computer-vision systems. The field has since learned how to get neural networks to imitate the way we reason, hear, speak, and write.

But while AI has grown remarkably human-like—even superhuman—at achieving a specific task, it still doesn’t capture the flexibility of the human brain. We can learn skills in one context and apply them to another. AI can’t.

Researchers have many hypotheses about how this problem might be overcome, but one in particular has gained traction: combining senses and language to give an AI a more human-like way to gather and process new information. The hope is that these “multimodal” systems, with access to both the sensory and linguistic “modes” of human intelligence, should give rise to a more robust kind of AI that can adapt more easily to new situations or problems. Read the full story.

"