Golang on NotNil Blog

Our GenAI tech stack in production

Wed, 05 Feb 2025 00:00:00 +0000

Let’s talk GenAI tech (but not LLMs)!

I was sharing my Monday observations on the GenAI market, and notably the importance of a robust software foundation.

The fundamentals of a GenAI platform

A GenAI platform rests on fundamental elements: task orchestration (often asynchronous), agents with memory management, intelligent document parsing, a high-performance vector database, and fine-grained observability of LLM generation.

If you do a Google search, sorry, Perplexity, you’ll be offered LangChain or llamaIndex, 2 “popular” frameworks that have the elements cited above. In the end we set LangChain aside; its abstraction layer turned out to be more of a hindrance than anything else. A GenAI project is above all a project of flow orchestration and API calls, nothing that requires a framework.

T-OTP

Sun, 27 Nov 2022 00:00:00 +0000

Article originally written for the Coddity blog

For a while now I’ve been building, in my spare time, a complete authentication service, with the aim of implementing a lot of authentication mechanisms: magic link, login/password, Oauth2, account validation, password recovery, and the famous 2FA.

I’ll admit I used Google Authenticator every day without ever thinking to look at the mechanism “under the hood”. This article is the plain-language version of what I learned.

A cup of Gitea

Sat, 19 Nov 2022 00:00:00 +0000

$20

For 5 years at Coddity we had been using Gitlab’s free tier. With a private namespace, we hosted the code of every side project in the company as well as our SaaS products, the whole thing coming to about 30 users, fifty or so small projects, and 2 bigger projects using Gitlab-CI.

In March 2022, Gitlab announces the end of the free tier for private domains above 5 users. Ok, that’s fair, every company needs to generate revenue and we got plenty out of the freemium offer.