2 posts tagged with "embedding_models"

[Continuing] Beyond LLMs/Transformers​

The power-waste, inefficiencies, and general limits of throwing large corpora of labeled data into a blender to create probability distributions of next-token are becoming apparent to the broader world.

Useful to create once, and part of the solution, but not the answer.

The below is a snapshot in time of my evolving thought process on how to deal with information aging out in learning models. I may periodically refresh that thinking in place or extend to a new post.