96% Correct Next Token Prediction, with No DNN, no Training, auto-distilled model
Over the last 12 months, I’ve built a model to predict the next token and to suggest synonyms or related queries to a user prompt, with 100% correct predictions on the training set in one shot, without training or deep neural networks (DNNs). The same model is now integrated in some of the most recent […]
Read More
Invitation to Crack Codes Using AI
Could you use AI to crack a cypher? For instance, predict the next bits in bitstreams produced by a high-quality PRNG (pseudo-random generator). Or correctly guessing the next bit in sub-sequences of 100,000 consecutive binary digits of π starting at arbitrary positions, with a success rate above 55%. Without knowing that the digits come from […]
Read More
xLLM: 30 Articles Shaping the Future of Enterprise AI in 2026
Over several decades, I unlearned everything that I learned in college classes, and built a new discipline from scratch, as much different from traditional AI than it is from standard machine learning, statistics and computer science. Outside academia with a focus on practical applications. Item #2 in the list below is the culmination of this […]
Read More
New Book: No-Blackbox, Secure, Efficient AI and xLLM Solutions
Large language models and modern AI is often presented as technology that needs deep neural networks (DNNs) with billions of Blackbox parameters, expensive and time consuming training, along with GPU farms, yet prone to hallucinations. This book presents alternatives that rely on explainable AI, featuring new algorithms based on radically different technology with trustworthy, auditable, […]
Read More
Watermarking and Forensics for AI Models, Data, and Deep Neural Networks
In my previous paper posted here, I explained how I built a new class of non-standard deep neural networks, with various case studies based on synthetic data and open-source code, covering problems such as noise filtering, high-dimensional curve fitting, and predictive analytics. One of the models featured a promising universal function able to represent any […]
Read More
10 Tips to Boost Performance of your AI Models
These model enhancements techniques apply to deep neural networks (DNNs) used in AI. The focus is on the core engine that powers all DNNs: gradient descent, layering and loss function. Reparameterization — Typically, in DNNs, many different parameter sets lead to the same optimum: loss minimization. DNN models are non-identifiable. This redundancy is a strength that […]
Read More
A New Type of Non-Standard High Performance DNN with Remarkable Stability
I explore deep neural networks (DNNs) starting from the foundations, introducing a new type of architecture, as much different from machine learning than it is from traditional AI. The original adaptive loss function introduced here for the first time, leads to spectacular performance improvements via a mechanism called equalization. To accurately approximate any response, rather […]
Read More
Synthesizing Multi-Table Databases: Model Evaluation & Vendor Comparison
Synthesizing multi-table tabular data presents its own challenges, compared to single-table. When the database contains date columns such as transaction or admission date, a frequent occurrence in real-world datasets, generating high quality synthetizations and model evaluation are even more complicated. In this article, we focus on this type of problems, comparing generated observations produced by […]
Read More
New Book: State of the Art in GenAI & LLMs — Creative Projects, with Solutions
With 23 top projects, 96 subprojects, and 6000 lines of Python code, this vendor-neutral coursebook is a goldmine for any analytic professional or AI/ML engineer interested in developing superior GenAI or LLM enterprise apps using ground-breaking technology. This is not another book discussing the same topics that you learn in bootcamps, college classes, Coursera, or […]
Read More
New Book: Understanding Deep Learning
By Simon Prince, computer science Professor at the University of Alberta. To be published by MIT Press, Dec 2023. The author shares the associated Jupyter notebooks on his website, here. Very popular, it got over 5,000 likes when the author announced the upcoming book on LinkedIn. I pre-ordered my copy. Summary An authoritative, accessible, and […]
Read More
You must be logged in to post a comment.