Tagged "Academia"

2023-05-09 | Technology AI Academia

From NNs to Transformers

History The development of Transformer models in AI research is built upon a rich scientific heritage spanning several decades. Key milestones and contributions from basic neural networks (NNs) to modern Transformer architectures include:
> read more · 62kB · 8668 words · 25 minutes
2023-05-02 | Technology AI Academia

Words with LLMs

Large Language Models (LLMs), such as GPT-4, represent words using a combination of tokenization, word embeddings, and context information.
> read more · 19kB · 2531 words · 8 minutes
2022-12-08 | Academia

Information Silo

The academic publishing industry in general, and Elsevier specifically, are a curse upon academia and human progress in general. But they only have power if we give it to them. There is still hope that one of these days, young academics will choose to simply not publish there anymore, and when the old guard dies off so will interest in the old information silos.
> read more · 1kB · 216 words · 1 minute