nowfound

Work · December 15, 2023

G7

GEITje-7B – A New Large Open Dutch Language Model

Tried my hand at training a large open Dutch language model, for which the pickings are slim right now. GEITje is a large open Dutch language model with 7 billion parameters, based on Mistral 7B. I've continued pretraining it on 10 billion tokens of Dutch text. This has improved its Dutch language skills and increased its knowledge of Dutch topics. There's an experimental chat-finetuned model too, called GEITje-chat. I have to say the experience of gathering a dataset and training a model has been very educational for me. Being forced to deal with every detail yourself really deepens your…

In plain words

GEITje-7B is an open-source Dutch language model with 7 billion parameters built on Mistral 7B. The model was further trained on 10 billion tokens of Dutch text to improve its proficiency with the Dutch language and knowledge of Dutch-specific topics. An experimental chat-finetuned variant called GEITje-chat is also available. The model is designed for developers and researchers who need a specialized Dutch language model for natural language processing tasks.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Tried my hand at training a large open Dutch language model, for which the pickings are slim right now. GEITje is a large open Dutch language model with 7 billion parameters, based on Mistral 7B. I've continued pretraining it on 10 billion tokens of Dutch text. This has improved its Dutch language skills and increased its knowledge of Dutch topics. There's an experimental chat-finetuned model too, called GEITje-chat. I have to say the experience of gathering a dataset and training a model has been very educational for me. Being forced to deal with every detail yourself really deepens your understanding of a subject. It's all in the hands of the community now. Can't wait to see what they do with it! Want to try it out? There's a demo live at Hugging Face Spaces right now: https://huggingface.co/spaces/Rijgersberg/GEITje-7B-chat

More work this month

the category →
  • Let agents source clips from terabytes of your local video

    Work · 18d ago · clipto.com

  • Free local transcription that is 100% Private

    Work · 17d ago · hynote.ai

  • The app store for voice native apps that lives in your notch

    Work · 28d ago · voiceos.com

  • Ask any question, get a video back instantly

    Work · 24d ago · scrimba.com

  • Handle all of the work before, during, and after meetings

    Work · 17d ago · calendly.com

Launched alongside, December 2023

the whole month →
  • BM

    Hi HN! I’m proud to share that we have built a real 3rd party iMessage client for Android. We did it by reverse engineering the iMessage protocol and encryption system. It's available to download today (no waitlist): https://play.google.com/store/apps/details?id=com.beeper.ima and there's a technical writeup here: https://blog.beeper.com/p/how-beeper-mini-works. Unlike every other attempt to build an iMessage app for Android (including our first gen app), Beeper Mini does not use a Mac server relay in the cloud. The app connects directly to Apple…

    Commerce · 2023 · beeper.com

  • HA

    Hey! I made Heynote entirely for my own use case. For many years, I always had an Emacs instance running with the scratch buffer open, even long after I had abandoned Emacs as my programming editor in favor of more recent IDE:s. The simplicity of having just one big scratch buffer appeals to me, but I still want to separate the different things I jot down somehow (without using tabs or similar). Previously, my solution was to insert a bunch of blank lines between the notes, but hitting C-A would still select the entire buffer. That's why I came up with the concept of "blocks", which turned…

    Work · 2023 · heynote.com

  • LogoFast988

    Make beautiful logos with AI, fast & free

    AI · 2023 · logofa.st

  • FuseBase941

    Client collaboration platform for professional services

    Dev tools · 2023 · thefusebase.com

  • Beep! 2.0871

    Fastest tool to assign and share visual tasks with your team

    Work · 2023 · justbeepit.com

  • Clean up your inbox in minutes, open source

    AI · 2023 · getinboxzero.com