Nvidia to Resolve Dilemma
Reuters is reporting that The Wall Street Journal is reporting that Nvidia is developing a new chip to accelerate AI inference, presumably meaning to slash chatbot latency. Set to be announced at GTC San Jose next month, the chip will incorporate technology from Groq, which Nvidia recently "licensed."
If Nvidia releases a new architecture, it will be covered in business-school cases for decades. Per the Innovator's Dilemma, companies typically don't launch technology that obviates their existing technology. Few try, and those that try rarely succeed (cf Itanium). Nvidia is surely aware of the factors causing the dilemma. Its abundant resources enable it to address these factors as it develops and releases a new architecture, and it's unlikely to pull a New Coke and stop making GPUs. If any company can successfully break from successful product technology, it's Nvidia. And if it fails, it has the resources to absorb the losses.
