Tagged "AI"

2023-06-05 | Technology AI

Media and Politicians AI-Panicking

It's no longer just a moral panic, it's a global media meltdown. Geoffrey Hinton quit Google (after years of working on literal AI-assisted world domination) to conduct interviews on any outlet who'll have him, having very public realizations about the completely unexpected and sudden dangers of AI development. There is no media site or news channel on the planet NOT talking about the horrible, terrible, world-destroying dangers of AI right now. As a response, the general population is panicking as well, and inevitably, so are politicians. What's going on? Are LLMs really signalling the end times?
> read more · 6kB · 1042 words · 3 minutes
2023-05-26 | Technology AI

Beyond Stateless Learning

LLMs like GPT are pre-trained and cannot continue learning in their current form. It is infeasible to retrain gigantic models from scratch every few months. We must develop strategies to overcome this limitation and enable continuous learning in language models.
> read more · 3kB · 401 words · 2 minutes
2023-05-09 | Technology AI Academia

From NNs to Transformers

History The development of Transformer models in AI research is built upon a rich scientific heritage spanning several decades. Key milestones and contributions from basic neural networks (NNs) to modern Transformer architectures include:
> read more · 62kB · 8668 words · 25 minutes
2023-05-02 | Technology AI Academia

Words with LLMs

Large Language Models (LLMs), such as GPT-4, represent words using a combination of tokenization, word embeddings, and context information.
> read more · 19kB · 2531 words · 8 minutes