flipboard.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Welcome to Flipboard on Mastodon. A place for our community of curators and enthusiasts to inform and inspire each other. If you'd like to join please request an invitation via the sign-up page.

Administered by:

Server stats:

1.2K
active users

#ollama

10 posts10 participants1 post today

Good or bad? My laptop with a 12th gen i7-12800H and an #nvidia A1000 gpu can sustain 3.8ghz turbo on all cores, almost a 1 ghz turbo (sustained) over the 2.9ghz promise from #intel. I am using Ollama and Gemma3:27b to beat on it. GPU is a bit of a lap potato of course and hovers around 65C, while the CPU rides 96C.

Tokens per second is about 25.

#ollama#AI#LLM

I've done some #vibehosting yesterday... I couldn't be bothered investigating why #fail2ban keeps banning my IP after fetching emails from my email server, so I've decided to delegate my issues to #ollama.

I've set a knowledge base with all the necessary config and log files, etc, and asked #QwQ to investigate... Since it's a #localLLM, I had no issues submitting even the most sensitive information to it.

QwQ did come up with tailored suggestions on how to fix the problem. #openwebui

Hallo schlaues Fediverse, ich tauche gerade in ein völlig absurdes #Rabbithole und mein M1 Macbook hat dank #LlmStudio und #Ollama seinen Lüfter wiederentdeckt… Aktuell ist lokal bei #LLM mit 8-12b Schluss (32GB Ram). Gibt es irgendwo #Benchmarks die mir bitte ausreden, dass das mit einem M4 >48GB RAM drastisch besser wird? Oder wäre was ganz anderes schlauer? Oder anderes Hobby? Muss Mobil (erreichbar) sein, weil zu unsteter Lebenswandel für ein Desktop. Empfehlungen gern in den Kommentaren.

🚀 Nouveau post sur Firebleu Website !

J’explore aujourd’hui l’auto-hébergement d’une IA puissante grâce à Deepseek, un modèle impressionnant à tester chez soi !
Tu veux garder le contrôle sur tes données ? Ce guide est pour toi 🧠🔒

👉 Lien : firebleu.website/deepseek-et-l

- · Deepseek et l’auto-hébergement : la solution miracle ? -
More from laflammebleutée

Introducing MoonPiLlama

Adam Jenkins has made a Youtube video showing how to install #MoodleBox and Ollama on a Raspberry Pi4. MoodleBox is a custom distribution of #Moodle specifically for the Raspberry Pi. However the Moodle part includes good information on generally how to get Ollama and Moodle to work together. It also includes gratuitous use of a yellow rubber duck
(Yes Pi 4 not Pi 5).

youtube.com/watch?v=KqQfzhJJFP

Replied in thread

@nothingfuture I haven't dug in too deep into it (yet) but you could find more information about the training data that was used for the models they list in the Google Doc.

For instance, huggingface.co/microsoft/Phi-3 was "trained with the Phi-3 datasets that includes both synthetic data and the filtered publicly available websites data with a focus on high-quality and reasoning dense properties."

#nercomp25 #AI #ollama

huggingface.comicrosoft/Phi-3-medium-128k-instruct · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.