Microsoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism

Microsoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism

Will LLMs keep improving if we throw more compute at them? OpenAI dealmaker thinks so.

Microsoft CTO Kevin Scott Thinks LLM 'Scaling Laws' Will Hold Despite Criticism

An anonymous reader quotes a report from Ars Technica: During an interview with Sequoia Capital's Training Data podcast published last Tuesday, Microsoft CTO Kevin Scott doubled down on his belief that so-called large language model (LLM) "scaling laws" will continue to drive AI progress, despite so...