Orply.

Hugging Face

Hugging Face is a platform where the AI community collaborates on models, datasets, research papers, and applications, with an emphasis on open science and open source.

Pi Durable Resumes Interrupted Agent Work From Persistent Checkpoints

Alejandro Ao describes Pi Durable as a harness for agent applications that need to recover task state after crashes or interruptions, not as a coding-agent CLI. It stores conversations and checkpoints so work can resume when the host process starts again, while leaving tool replay safety and process restarts to the surrounding application. In a tutorial, Ao walks through the harness setup and demonstrates recovery with a local model and SQLite.

Alejandro AOOct 19, 20268 min read

RTX 5090 Outruns M5 Ultra on Models That Fit in VRAM

A comparison of Apple’s M5 Ultra Mac Studio and NVIDIA’s RTX 5090 finds the graphics card faster on a Qwen3.8-27B test, leading in prompt processing and token generation. Its advantage depends on the model fitting within 32 GB of VRAM; the Mac’s 256 GB of unified memory can hold models that exceed that limit, making capacity—not benchmark speed—the deciding factor for larger local AI workloads.

Oct 14, 20264 min read

Odysseus Separates the Agent Harness From the Model It Runs

PewDiePie’s Odysseus separates the agent application from the model it uses: the workspace coordinates tools and information, while Ajax, a fine-tuned Qwen 3.5 9B model, is intended to make tool-use decisions. In his breakdown, Alejandro AO argues that building a useful local agent depends not just on running software on your own machine, but on where the model runs and whether it can reliably use the harness’s tools. He explains how the agent loop works and why training on traces from the target setup may help a smaller model perform better.

Alejandro AOOct 13, 20268 min read

AI Coding Agents Can Build Dashboards, but Analysts Must Define the Questions

Alejandro AO argues that AI coding agents can build a working business dashboard quickly, but that speed does not replace the analyst’s judgment. In a bank marketing example, he starts by defining what campaign managers need to learn, checks what the dataset can support, and specifies KPIs before asking an agent to build the interface. He then reviews and revises the charts, while cautioning that observed patterns do not establish what caused them—or what will improve the next campaign.

Alejandro AOOct 12, 20269 min read

Reachy Mini Turns Expressive Movement Into Its Desktop-Robot Pitch

Pollen Robotics and Hugging Face introduce Reachy Mini, an open-source desktop robot, through a music video built around the machine’s own recorded movements. The video’s case for the small robot rests on its expressive head and antenna motions, visible construction and simple prompt-and-response interaction; it also extends the open-source invitation to the film itself, which viewers can scrub through and fork.

Oct 8, 20264 min read

Pi Workspaces Turn Telegram Into a Gateway for Always-On AI Agents

Alejandro’s tutorial shows how to run specialized Pi assistants on an always-on machine and reach them through Telegram using his open-source `pi-gateway`. Each assistant runs from its own workspace, with its own instructions, tools and model; the gateway uses a local SQLite database to route messages to persistent Pi sessions. The demonstration covers a personal assistant and a research agent, while scheduled automations and support for other messaging platforms remain proposed extensions.

Alejandro AOOct 2, 20267 min read

Flow Matching Turns Distribution Learning Into Velocity Prediction

Aritra Gosthipaty presents flow matching as a distribution-learning method that turns Gaussian noise into data by training a model to predict velocities along constructed paths between the two. In his introductory tutorial, each training image is paired with noise and connected by a simple straight-line interpolation, making the correct velocity available as a training target; generation then follows the learned local velocity field from fresh noise. The browser-based digit demo shows both the mechanism and its limits under compressed representations and simple sampling.

Aritra GosthipatySep 15, 20268 min read

Pi Adds On-Device GGUF Models Through llama.cpp

Alejandro-ao shows how Pi can use GGUF models served locally through llama.cpp, keeping prompts, code and data on the user’s machine rather than sending them to third-party APIs. The setup depends on running a local llama.cpp server and choosing a quantized model that fits the available hardware; in his Apple M4 Max example, Hugging Face recommends Qwen 3.8-27B’s Q4_K_M variant. Pi’s `/llama` command then downloads and loads that model, making it available through the standard `/model` selector.

Alejandro AOSep 8, 20264 min read

Hugging Face Publishes 207 Device-Adaptive WebGPU Kernels

Hugging Face’s Nico Martin argues that browser AI should depend on versioned operation contracts rather than fixed GPU shaders. Its new `@huggingface/kernels` library loads WebGPU kernel templates from the Hub, validates typed inputs, and renders a WGSL variant suited to the current device’s supported data types and workgroup sizes. Martin says Fleet benchmarking extends that approach by collecting performance results from hardware Hugging Face cannot test directly.

Nico MartinSep 4, 20265 min read

Agent Memory Requires Extraction, Separate Stores, and Hybrid Retrieval

Alejandro Ao argues that persistent memory for AI agents is not a longer chat history or a single vector database, but a write-and-retrieve pipeline that extracts durable claims, stores them alongside entity links and recent context, then ranks them for later use. In his walkthrough of Mem0, semantic search supplies the candidate set while BM25 and entity-based signals rerank it; that design makes the vector index the system’s gatekeeper. Ao’s practical case is that the architecture can run locally with small extraction models and open embedding models.

Alejandro AOAug 17, 20269 min read

Stable Prompt Prefixes Cut Long AI Agent Input Costs

Alejandro AO argues that long-running AI agents become expensive because every turn reprocesses an expanding transcript, not just the latest user input. Prompt caching can sharply reduce that input bill by discounting previously processed prompt prefixes, he says, but only if an agent harness keeps system instructions and conversation history stable and append-only. Dynamic material placed early in a prompt, compaction, cache expiry and unenabled provider settings can all reset those savings.

Alejandro AOAug 10, 20267 min read

Tau Ports Pi’s Coding-Agent Architecture to a Textual Terminal

Alejandro Ao presents Tau as a Python implementation of Pi’s coding-agent harness, built to preserve Pi’s parent-linked sessions, core tools, skills, and event design rather than introduce a different agent architecture. He argues that Tau’s main departure is its Textual terminal interface, which makes a run’s context, tool activity, resource provenance, branching history, and exports visible alongside the conversation.

Alejandro AOJul 31, 20268 min read

Hugging Face Reveals Build Small Hackathon Winners After Hundreds of Submissions

Hugging Face said it had reviewed hundreds of creative projects from builders around the world for its Build Small Hackathon winners reveal, framing the announcement around the scale of participation and thanking both winners and entrants. The supplied material shows a submissions gallery and the reveal branding, but does not identify the winning projects, categories, prizes, or judging criteria.

Jul 10, 20262 min read

Tau Exposes Coding-Agent Architecture Through Three Readable Python Layers

Alejandro Ao presents Tau, a small Python coding agent, as an educational reference rather than a competitor to established tools such as Pi or OpenCode. He argues that Tau’s value is legibility: its three-layer architecture separates provider-neutral model streaming, the reusable agent loop, and the coding-specific terminal environment so developers can see how tools, sessions, model calls, and UI behavior fit together. The project is meant to be read, modified, and extended as a way to understand how coding agents work.

Alejandro AOJul 6, 20267 min read

Hermes Uses a Minimal Agent Loop to Preserve State Across Channels

Alejandro AO’s walkthrough of Hermes presents the agent as a deliberately small always-on system rather than a complex orchestration stack. He argues that Hermes’ usefulness comes from a simple loop that builds context from Markdown files, message history, tools, skills and memory, then preserves state through compression, SQLite transcripts, optional external memory providers, gateway integrations and scheduled cron jobs. The architecture’s central concern is continuity: keeping enough context across channels and time for the agent to behave like a persistent assistant.

Alejandro AOJun 17, 202611 min read

MiniCPM-V 2.6 Runs at 18 Tokens per Second on iPhone

OpenBMB used its Build Small hackathon session to argue that small models are valuable when they can be deployed where applications and data already live: on phones, laptops, mobile apps and edge devices. Its main example was MiniCPM-V 2.6, a vision-language model shown running on an iPhone 15 Pro at 18 tokens per second with llama.cpp and 4-bit quantization. The broader claim was that compact, open models paired with existing runtimes can expand access, reduce cloud dependence, and improve privacy and latency for local AI use cases.

Jun 10, 20266 min read

Hackathon Caps Models at 32B Parameters to Reward Tinkerable AI Apps

Build Small is a Hugging Face and Gradio hackathon organized around a hard constraint: every model used must be under 32 billion parameters. Yuvraj Sharma framed the rule as a way to move AI building away from dependence on giant hosted models and back toward systems that participants can inspect, fine-tune, run locally, and ship as working Gradio Spaces. Sponsor presentations from Black Forest Labs, OpenBMB, OpenAI, NVIDIA, Modal, JetBrains, and Cohere largely reinforced that premise, offering small models, credits, tools, and prize categories meant to turn the constraint into runnable projects rather than demos in name only.

Shashank Verma · Vaibhav Srivastav · Stephen Batifol · Julian Mack · Yuvraj Sharma · Felicia Chang · Nikita Pavlichenko · Hannah Blair · Zhong ZhangJun 5, 202620 min read

LeLab Brings No-Code Training to the LeRobot Robotics Pipeline

Hugging Face presents LeLab as a graphical interface for its LeRobot library that moves much of the robot-learning workflow out of the command line after installation. The source argues that users can configure and calibrate robot arms, add cameras, collect and clean demonstration datasets, train policies locally or on Hugging Face Jobs, and test checkpoints on the robot through one GUI. It also makes clear that LeLab reduces operational friction rather than removing the hard parts of robot learning: the user still has to assemble hardware, teleoperate consistently, record good demonstrations, and evaluate behavior on the physical robot.

Nikodem BartnikJun 3, 20266 min read

FineWeb Shows LLM Dataset Quality Depends on Measured Web Filtering

Alejandro Ao’s overview of Hugging Face’s FineWeb argues that building a competitive LLM pretraining dataset from Common Crawl is a measurement-driven engineering process, not a matter of collecting more web text. He presents FineWeb as an open recipe in which Hugging Face chose raw HTML extraction over Common Crawl’s text extracts, found that global deduplication removed valuable data, and selected filters by training and evaluating small models. The same logic underpins FineWeb-Edu, where Llama-3-70B labels were distilled into a smaller classifier to filter the corpus for educational value at scale.

Alejandro AOJun 2, 202611 min read

Transformers.js Turns Local AI Models Into JavaScript Pipelines

Nico Martin presents Transformers.js as the JavaScript application layer around local AI models, not the engine that performs the model math. In his explanation, ONNX defines the model graph and weights, ONNX Runtime executes the computation, and Transformers.js handles the surrounding work: loading assets, converting inputs to tensors, selecting devices and precision, and decoding outputs. Martin argues that this task-based abstraction is why one `pipeline()` API can support very different workloads, from text generation to depth estimation, while hiding much of the model-specific wiring from developers.

Nico MartinMay 27, 20267 min read

Pre-Training Scale Is Losing Ground to Adaptive AI Systems

Sara Hooker, co-founder of Adaption Labs, argues in a Hugging Face ML Club India talk that AI progress is moving away from ever-larger pre-training runs as the default path and toward systems that adapt more efficiently after deployment. She says compute still matters, but the higher-return questions now concern data curation, post-training, test-time compute, interfaces, routing, and how cheaply models can learn from new information. Her case is that monolithic, one-size-fits-all models push the cost of adaptation onto users and concentrate participation among labs with the largest compute clusters.

Sayak Paul · Aritra Gosthipaty · Sara HookerMay 21, 202620 min read