Skip to main content

LLM Analysis Which One Is The Best?

· 3 min read
Ilham Surya
Ilham Surya
SRE Engineer - Fullstack Enthusiast - Go, Python, React, Typescript

This time we will explore about Large Language Models (LLMs)! We’re diving into how these AI tools are changing the way we communicate and work

Alt text

What Is LLM​

alt text

What To Consider When Choosing LLM​

There is various ton of LLM available in the internet. but for the beginner especially me. sometimes its hard to choose which model is the best. but there is some metrics that i suggest to use before using certain LLM Model

Cost & Accessibility​

This is for me is the most important key metrics to consider when choosing LLM. because not every LLM can be used for free or maybe there is some LLM that implement rate limit after certain million token uses. so for free-user this is very important things to note

Performance & Capabilities​

After trying some LLM. each of them have similiar response time and answer depend on your use case. but particullary its important to measure up by using 1 LLM for 1-2 weeks before changing to other LLM. this approach can give more legit conclusion than reading the internet. My ranking currently still like this: ChatGPT 4.0 (Free Version), Gemini 1.5 Pro, Meta LLama 3.2

Framework Or Benchmark For LLM​

alt text

LLM Analysis​

OpenAI​

alt text

After trying the OpenAI. the API Key cannot be used outside the chat.openai.com if you not inserting credit card or subscribing to its service. but still can be used from the web. the response time in my opinion is the fastest compare with 3 other LLM. and it given free-trial of GPT4.0 for short time every day that give valid and good answer. so its pretty worth if trying to use its API Key

Anthropic Claude​

alt text

Anthropic Claude need some credit before using it. so i just try it on free-trial slow model in cursor code editor

alt text

and although im using it slow version. but it accuracy of answer really in the same level with chatGPT 4.0 and the pros is you can try the slow-version of it for free inside cursor

Google Gemini​

alt text

Gemini offer free-model that can be integrated with continue.dev or aider. so far this is the most used LLM model for me since it free and its rate limit pretty big

Other Model​

GroqAPI, MistralAI, Meta Llama

LLM OpenSource Tools​

There is a lot of service to try each LLM model before you paid subscription of it. i will give some examples

OpenRouter AI​

alt text

Openrouter provide all LLM model to interact with. but need some credit before using it

Anakin.AI​

alt text

Anakin provide some free-sample model of most popular LLM like GPT-4, Claude 3.5 Sonnet, xAI Grok 2. this tools more good than openrouter since it didnt require any credit and need login only