96% Correct Next Token Prediction, with No DNN, no Training, auto-distilled model
Over the last 12 months, I’ve built a model to predict the next token and to suggest synonyms or related queries to a user prompt, with 100% correct predictions on the training set in one shot, without training or deep neural networks (DNNs). The same model is now integrated in some of the most recent […]
Read More
Invitation to Crack Codes Using AI
Could you use AI to crack a cypher? For instance, predict the next bits in bitstreams produced by a high-quality PRNG (pseudo-random generator). Or correctly guessing the next bit in sub-sequences of 100,000 consecutive binary digits of π starting at arbitrary positions, with a success rate above 55%. Without knowing that the digits come from […]
Read More
NPG: New Random Generator, 3x Faster & Stronger than PCG64
The NumPy library in Python, and many other systems, relied on the Mersenne Twister PRNG (pseudo-random number generator) for a long time. It was slow and did not mimic randomness well enough, failing some statistical tests. In addition, it could be cracked, raising security issues. It was replaced recently by PCG64 which addresses some of […]
Read More