
Credit: Edgar Cervantes / Android Authority
- A new report suggests that Amazon is struggling to develop a large language model (LLM) that can compete with OpenAI and Google.
- The model is set to power an already-announced Alexa upgrade that brings conversational abilities to the assistant.
- Limited data sets and a lack of vision stalled progress, leading to the exit of many talented researchers and scientists.
A new report has come to light that suggests Amazons generative AI-powered
Alexa is nowhere near completion and may never even see the light of day. The report, compiled by
Fortune through interviews with over a dozen former employees, lists several hurdles that the company has faced while developing its conversational AI. Amazon demoed its next-generation Alexa late last year and promised to launch a limited preview in the US “soon.âà ¢â€šÂ¬Ã‚ Eight months have passed, however, with no sign of the new Alexa.
According to the report, the lack of high-quality data has slowed down Amazons large language model (LLM) efforts tremendously. The e-commerce company lacks extensive datasets as it doesnt operate a search engine like Google or social networks like Meta. As a result, its LLM was trained on just three trillion tokens  the smallest unit of data in a language model. For comparison, OpenAIs GPT-4 model is believed to have been trained on 13 trillion tokens.
More...