How long does it take to run gpt-oss:20b?

gpt-oss is OpenAI’s open-weight models designed for powerful reasoning, agentic tasks, and versatile developer use cases. You can easily use it via Ollama and read more about it in their blog post. Let’s see how long it takes to generate some output using the same prompt on some of my computers at home. For this…

Continue Reading

Retrieval-Augmented Generation

Back in February I learned about Open WebUI and have been wanting to test it out with Retrieval-Augmented Generation (RAG). I’ll follow the tutorial available on Open WebUI’s site. The goal of RAG is to provide Large Language Models (LLMs) with specific information with the goal of improving the output. My main interest in RAG…

Continue Reading

Doing the same thing over and over

There’s this quote that is commonly attributed to Albert Einstein (though it’s uncertain whether he really said it or not): Insanity is doing the same thing over and over again and expecting different results. I first came across it a long time ago, when I was much less discerning. After reading it, I envisioned someone…

Continue Reading

Thoughts on AI

I have been interested in machine learning since I was a PhD student back in 2010. I was always in awe of papers where they applied machine learning to cluster or classify data. My original PhD topic was to discover biomarkers in blood for Parkinson’s Disease (PD) patients that were early onset and had not…

Continue Reading

TIL about Open WebUI

I just heard about Open WebUI from Harish’s comment on my Ollama and DeepSeek post and decided to check it out. From their website: Open WebUI is an extensible, feature-rich, and user-friendly self-hosted AI platform designed to operate entirely offline. It supports various LLM runners like Ollama and OpenAI-compatible APIs, with built-in inference engine for…

Continue Reading

TIL about Ollama and DeepSeek

I guess by now you have probably heard about DeepSeek. If in the extremely unlikely event that you have come across this post before reading about DeepSeek, please go look them up. When I first heard about them and their amazing LLM models, the first thing I wanted to do was to try them out!…

Continue Reading