Parsing Natural Scenes and Natural Language with Recursive Neural Networks
“I granted the AI access to the cameras on your Wizer,” he said. “Remember when I told you about frames and how the AI could take snapshots of your environment, then run image and feature recognition?”
“Yeah…” was all I could manage.
“That’s what It just did. The AI takes a snapshot every few seconds when you’re wearing the Wizer and creates a frame. The name of the bridge on the sign above is one of the prominent symbols to be recognized.”
“The AI also gets help from GPS data. It then cross references the current frame with its database of memories… stored frames, and if it finds a match, [it] tells you. Memories, that’s all they are, but if they begin to fade, [it'll] remind you,” he said. – Memories with Maya
When writing Memories with Maya, a good deal of research was done on AI and AR, to make the science plausible. When actual science catches up to the creative spin on AI woven into the novel, it is encouraging.
Visit Socher.org to read more on Parsing Natural Scenes and Natural Language with Recursive Neural Networks , and download the actual source code and data-sets that the still image above is taken from.
(all images used are copyright Socher.org)