https://notnil.org/en/tags/architecture/Recent content in Architecture on NotNil BlogHugoen-US© Matthieu MoreauWed, 05 Feb 2025 00:00:00 +0000https://notnil.org/en/posts/24-squid/Wed, 05 Feb 2025 00:00:00 +0000https://notnil.org/en/posts/24-squid/<figure><img src="https://notnil.org/images/posts/squid/feature.png"> </figure> <p>Let&rsquo;s talk GenAI tech (but not LLMs)!</p> <p>I was sharing <a href="https://notnil.org/en/posts/23-rex2024/">my Monday observations</a> on the GenAI market, and notably the importance of a robust software foundation.</p> <h2 id="the-fundamentals-of-a-genai-platform">The fundamentals of a GenAI platform</h2> <p>A GenAI platform rests on fundamental elements: task orchestration (often asynchronous), agents with memory management, intelligent document parsing, a high-performance vector database, and fine-grained observability of LLM generation.</p> <p>If you do a Google search, sorry, Perplexity, you&rsquo;ll be offered LangChain or llamaIndex, 2 &ldquo;popular&rdquo; frameworks that have the elements cited above. In the end we set LangChain aside; its abstraction layer turned out to be more of a hindrance than anything else. A GenAI project is above all a project of flow orchestration and API calls, nothing that requires a framework.</p>