Modern LLMs seem to be getting better every few weeks, but they might soon add to their capabilities along a whole different dimension.
Microsoft AI CEO Mustafa Suleyman says that the company is working on LLM protypes that have “near infinite” memory. Suleyman said that having this infinite memory would be a transformative feature for AI models, and make them much more useful than they currently are.
“Memory is the critical piece because today because every time you go to your AI, you have a new session,” Suleyman said in an interview. “It has a little bit of memory for what you talked about last time or maybe the time before, but because it doesn’t remember the session five times ago or 10 times ago, it’s quite a frustrating experience to people. You don’t go and invest deeply and really share a lot and look to build on what you’ve talked about previously, because you know it’s going to forget. So you sort of tap out after a while and it turns into a shallower experience,” he added.
But Suleyman said that Microsoft was working on a solution to the problem. “We have prototypes that we’ve been working on that have near infinite memory. So (the LLM) just doesn’t forget, which is truly transformative. You talk about inflection points — memory is clearly an inflection point because it means that it’s worth you investing the time,” he says.
“Everything that you say to it, you’re going to get back in a useful way in the future. You will be supported, you will be advised, it will take care of, in time, planning your day and organizing how you live your life. So it’s that capability alone, which I expect to come online in 2025, is going to be truly transformative,” he continued.
Suleyman is one of the most prominent figures in AI. He was a co-founder of DeepMind, which was later acquired by Google. Earlier this year, Suleyman had joined Microsoft as its AI CEO. And while there has been talk of AI progress slowing down in recent months, it appears that an infinite memory feature could take LLM performance to a whole different level by next year.