GPTheory | Ivan Gentile AI Blog

Capabilities and Intelligence Emergence in LLMs

Ivan gentile, Aug 03, 2025, Llm Ai Intelligence Emergence Capabilities Machine-learning

I’ve been processing the new Krakauer, Krakauer & Mitchell paper on emergence in LLMs alongside Michael Levin’s recent work on ingressing mind” and there is much to chew. Both are...

The Art of Right Distance

Ivan gentile, Feb 17, 2025, Epistemology Complexity Learning Relationships Systems-thinking

Movement One: The Dance of Understanding I’ve been exploring a fascinating pattern that appears across domains: the principle of “right distance” - not as a fixed measurement, but as a...

some LLM evaluation keywords explained

Ivan gentile, Mar 04, 2024, Llm Evaluation Key-words Explained Benchmark

What does 0-shot CoT Maj@32 means? skip to the end for recap and answer When evaluating the capabilities of LLMs on tasks like question answering, researchers often use benchmarks consisting...

Agenti per LLM-based Apps Pro e Contro

Ivan gentile, Feb 28, 2024, Ai Llm Neural networks Rag Retrieval augmented generation Web applications Cybersecurity Prompt injection Human-in-the-loop

Definizione di agente Una qualsiasi entità che può percepire il suo ambiente tramite sensori e agire su quell’ambiente tramite attuatori. Nel contesto degli LLM, un agente può essere inteso come...

RAG vs FineTuning

Ivan gentile, Feb 28, 2024, Ai Llm Openai Mistral Neural networks Fine-tuning Machine learning pipeline Data prepartion Deep learning

Per migliorare le capacità degli LLM preaddestrati è possibile seguire due strategie: Un approccio basato su Retrieval-Augmented Generation (RAG) Un fine-tuning del modello preaddestrato RAG L’approccio RAG mira a potenziare...

Una Pipeline per migliorare gli LLM in Italiano

Ivan gentile, Jan 25, 2024, Ai Llm Openai Mistral Neural networks Fine-tuning Machine learning pipeline Data prepartion Deep learning

Introduzione Siamo tutti consapevoli delle potenzialità di ChatGPT. Si tratta probabilmente della killer app della decade (forse del secolo se i progressi continuano allo stesso rate?) e da quando è...

AlphaCodium Prompting Flow

Ivan gentile, Jan 22, 2024, Ai Llms Alphacodium Prompting flow

The new paper on AlphaCodium struck me for its usefulness in crafting good prompts for coding. I built a GPT that tries to emulate the steps. You can find it...

Oktober Web Cherries

Ivan gentile, Nov 01, 2023, Random links Cpus Maths Hacks

Thank you Nikos for the good time in Frankfurt! How numbers are stored in computers the above page also has this must see link Best gitrepo to study and review...

Do you remember, the webcherries you have picked in September

Ivan gentile, Sep 01, 2023, Random links Feynman Maths Hacks

Google Dorks from hack5 Lex Fridman conversation with Neri Oxman on silk worms. I did not know that they are not able to fly after metamorphosis, crazy effect of human...