In this article, you will find my PowerPoint presentation describing the most recent features of xLLM, a CPU-based, full context, secure multi-LLM with real-time fine-tuning & explainable AI. It includes several new diagrams describing the innovative architecture, upcoming developments, new features and different use cases.
Content
- Enterprise use case: corporate corpus of a Fortune 100 company.
- Original version dealing with large websites such as Wolfram and Wikipedia. Comparison with OpenAI.
- xLLM for clustering and predictive analytics. Use case: unstructured text (articles) from a media company.
- Integration of our game-changing NoGAN tabular data synthesizer, and state-of-the-art model evaluation technology.
- Integration of external tools, for instance to solve math problems.
- Upcoming version for auto-indexing and cataloging large repositories.
- Demo: enterprise xLLM in action, featuring the modern user interface (full web API, not just a prompt box) with command menu and numerous options not found in other LLMs, including debugging, suggested prompts, choice of agents, and fine-tuning in real time.
- Relevancy score displayed to the user, for each returned item. I call it the new PageRank for RAG/LLM, using a technology radically different from Google search. See picture.
The full code, datasets (input sources) and backend tables are on GitHub. Links are included in the PPT document. I also started a new series of articles discussing the main components at a high level. See “LLM Chunking, Indexing, Scoring and Agents, in a Nutshell”, here. Detailed documentation is available on my AI research blog, here. The most comprehensive material is in my new book “Building Disruptive AI & LLM Technology from Scratch”, listed as #7 on the same web page. There is even a course on xLLM, available here and based on my textbook “State of the Art in GenAI & LLMs — Creative Projects, with Solutions”.
New startup coming soon!
We will be launching soon (January) a new startup focusing on GenAI at scale for Enterprises; xLLM will be part of the offer with exclusive features. We are looking for early adopters to partner with us on the Journey.
The co-founder and CEO, to be announced soon, is Senior Director of GenAI at a Fortune 100 company, where the first version of Enterprise xLLM was implemented. More to come!
View and download the presentation
View the PowerPoint document, here. Presented for a large company on November 1st, 2024. I will share the video when available. To not miss future articles on this topic and about GenAI in general, subscribe to my free newsletter, here. Subscribers get a 20% discount on all my books.
About the Author
Vincent Granville is a pioneering GenAI scientist and machine learning expert, co-founder of Data Science Central (acquired by a publicly traded company in 2020), Chief AI Scientist at MLTechniques.com and GenAItechLab.com, former VC-funded executive, author (Elsevier) and patent owner — one related to LLM. Vincent’s past corporate experience includes Visa, Wells Fargo, eBay, NBC, Microsoft, and CNET. Follow Vincent on LinkedIn.