# Groq and Grok
**URL:** https://jtechforums.org/t/groq-and-grok/6288
**Category:** Artificial Intelligence
**Tags:** AI, LLM
**Created:** [March 27, 2026, 5:03am UTC](https://jtechforums.org/t/groq-and-grok/6288 "2026-03-27T05:03:03Z")
**Posts on this page:** 15
**Page:** 1
### Author:  [@Shalom\_Karr](https://jtechforums.org/u/Shalom_Karr)
#### Post date: [March 27, 2026, 5:03am UTC](https://jtechforums.org/t/groq-and-grok/6288/1 "2026-03-27T05:03:03Z")
Groq Ai
---
### Author:  [@DaWelch](https://jtechforums.org/u/DaWelch)
#### Post date: [December 29, 2025, 7:18pm UTC](https://jtechforums.org/t/groq-and-grok/6288/2 "2025-12-29T19:18:31Z")
# Groq: State of the Art Inference in 2025
## 1. Executive Overview
Groq is a pioneer in the AI hardware space, known for inventing the **Language Processing Unit (LPU)**. Unlike traditional GPUs that are general-purpose “train-and-run” chips, the LPU is a software-defined hardware architecture designed specifically for **sequential inference**. In December 2025, Groq made headlines by entering a non-exclusive $20 billion licensing agreement with NVIDIA to integrate LPU technology into NVIDIA’s “AI Factory” roadmap.
## 2. The Pros (Why it Leads the Market)
### Blazing Fast Speed (TPS)
Groq remains the speed leader for open-weight models.
- **OpenAI GPT OSS 120B/20B:** ~8k TPM
- **Llama 3.1 8B:** ~870+ Tokens Per Second (TPS).
- **Llama 3.3 70B:** ~280 - 400 TPS.
- **Llama 4 (17B/70B):** Optimized for near-instant reasoning cycles.
### Deterministic Latency
The LPU architecture is “software-defined.” It does not use dynamic scheduling or cache managers. This means latency is **fixed** —if a request takes 150ms during your test, it will take 150ms in a production environment with 10,000 users.
### Developer-Friendly Limits (Dec 2025 Data)
Groq’s rate limits on the Developer tier are significantly more generous than competitors like Google or OpenAI:
- **Daily Requests:** Up to 14,400 RPD (Requests Per Day) on certain models.
- **Tokens Per Minute:** ~70,000 - 200,000 TPM.
- **API Compatibility:** Full OpenAI-compatible headers and endpoints.
### Power Efficiency
The LPU v2 (built on Samsung’s 4nm process) is roughly **10x more energy-efficient** per token than standard GPU clusters, significantly lowering the “carbon cost” of real-time AI agents.
* * *
## 3. The Cons (Limitations & Trade-offs)
### The “SRAM” Memory Wall
Each LPU chip has only a few hundred megabytes of on-chip SRAM. While this makes it fast, it means large models (like Llama 70B) require hundreds of chips linked together.
- **Consequence:** You cannot run a massive “frontier” model on a single Groq chip; it requires a data-center-scale rack (GroqRack).
### Inference Only
You **cannot train** or fine-tune models on Groq. It is strictly a delivery engine for pre-trained weights.
### Proprietary Ecosystem
While the API is open, the compiler and hardware are closed. Unlike NVIDIA’s CUDA, which has 15 years of community libraries, Groq’s low-level optimizations are handled entirely by Groq’s proprietary compiler.
* * *
## 4. Technical Comparison Table
| Feature | Groq LPU (2025) | NVIDIA H200/B200 |
| --- | --- | --- |
| **Architecture** | Deterministic SRAM | Dynamic HBM3e |
| **Primary Goal** | Ultra-low Latency | High Throughput / Training |
| **Jitter** | Zero (Fixed Latency) | High (Variable based on load) |
| **Scaling** | Linear (Performance scales with chips) | Logarithmic (Overhead increases with scale) |
| **Best Use Case** | Real-time agents, Voice, Logic-chains | Large-scale Batching, Training |
* * *
Yes, this post was written with AI. Hate me, I don’t have time to do this myself.
Many thanks to @Dev-in-the-BM_2.0 for introducing me to Groq’s lightning speeds
---
### Author:  [@Shalom\_Karr](https://jtechforums.org/u/Shalom_Karr)
#### Post date: [December 29, 2025, 9:20pm UTC](https://jtechforums.org/t/groq-and-grok/6288/3 "2025-12-29T21:20:02Z")
> [@DaWelch](#):
>
> Yes, this post was written with AI. Hate me, I don’t have time to do this myself.
We all use AI for these long posts. Don’t worry
---
### Author:  [@YourMenahel](https://jtechforums.org/u/YourMenahel)
#### Post date: [December 30, 2025, 2:13am UTC](https://jtechforums.org/t/groq-and-grok/6288/4 "2025-12-30T02:13:42Z")
OK I’m going crazy. Is it Groq or Grok? Because when I first heard of it I thought of it like Groq, and everyone seems to agree like the post above but now I just checked and its actually [grok.com](http://grok.com)
---
### Author:  [@PleaseSmileToday](https://jtechforums.org/u/PleaseSmileToday)
#### Post date: [December 30, 2025, 2:22am UTC](https://jtechforums.org/t/groq-and-grok/6288/5 "2025-12-30T02:22:19Z")
Groq makes LPU chips, grok is the AI.
---
### Author:  [@YourMenahel](https://jtechforums.org/u/YourMenahel)
#### Post date: [December 30, 2025, 2:23am UTC](https://jtechforums.org/t/groq-and-grok/6288/6 "2025-12-30T02:23:44Z")
I guess thats what happens when you dont read the article and only glance at the first five words lol. Sorry
---
### Author:  [@TripleU](https://jtechforums.org/u/TripleU)
#### Post date: [December 30, 2025, 4:38am UTC](https://jtechforums.org/t/groq-and-grok/6288/7 "2025-12-30T04:38:17Z")
The above post is about **GroQ**.
For the people mixing it up with **Grok** — here’s what **Grok** is these days, in my opinion.
**Grok sucks.**
- **Bad at coding.** Hallucinates APIs, messes up basics, and falls apart the moment things get non-trivial.
- **Bad usage limits.** You hit walls fast, unpredictably, and for no good reason.
- **Bad at information.** Trusts bad sites, distrusts good ones. Confidently wrong way too often.
- **Way too much propaganda.** Stuff like **@dodgedesigner** acting as Elon’s hype dog, or Elon himself posting things like _“Grok used the most tokens this year”_ — all of that is meaningless trash. Token count ≠ quality.
- **Poor feature set.** Look at **Gemini “Nano Banana 3”** , **ChatGPT Pulse** , **Year in Review** , **Research mode** , etc. Grok is terrible by comparison.
- **Bad video generation.** Yes, I said it. Look at **Veo 3** , look at **Sora 2**. I don’t care if it takes longer — I’d rather wait 5 minutes for good results than get pure trash instantly.
- **Tons of bugs.** From _Mecha-Hitler_ to _Elon fighting a dinosaur_ — every day is a new Grok episode.
- **Very pritzusdik.** Not going to be מאריך on this, but it’s obvious.
- **Random failures.** “Failed to reply” popping up mid-response, randomly, all the time.
- **Everyone else is just far more sophisticated.** Custom GPTs, **Codex** , **Jules** , real API usage — all of it is miles ahead.
- I can’t think of everything right now, but **Grok is genuinely the worst today and it’s not going to get better**.
Elon lives inside his **X bubble**.
Whatever people hype on X, he listens to. People constantly say Grok is good so they won’t get ratioed, they get likes, and the algorithm rewards it. Elon sees that and thinks everything’s fine.
It’s not.
Grok genuinely sucks at almost everything, and other AI agents — **Gemini** and **OpenAI** especially — are _far_ ahead.
**Bottom line:**
**LLaMA from Meta will probably always be the worst** , but Grok is right down there at the bottom too.
> **Examples of Grok hype / propaganda on X**
>
> • Elon Musk hyping Grok’s usage/token dominance leaderboard placement:
> 👉 [Elon Musk on X: "Grok Code just hit #1 on the OpenRouter leaderboard, beating Claude Sonnet" / X](https://x.com/elonmusk/status/1961677739762790630) :contentReference[oaicite:0]{index=0}
>
> • Another X post celebrating Grok’s #1 position and token share on OpenRouter:
> 👉 [KARDASHEV on X: "Elon Musk reposted a post from Tesla Owners Silicon Valley https://t.co/Un4GvHtpva" / X](https://x.com/ElonAlertsX/status/2001212681198407752) :contentReference[oaicite:1]{index=1}
>
> • X user screenshot bragging about Grok using the most tokens (often framed as “proof it’s best”):
> 👉 [https://x.com/artem\_aero/status/200xxxxxxx](https://x.com/artem_aero/status/200xxxxxxx) (search result example) :contentReference[oaicite:2]{index=2}
>
> • X account reposting leaderboard claims tied to Musk hype:
> 👉 [https://x.com/tymanmayo2/highlights/xxxxxxxxx](https://x.com/tymanmayo2/highlights/xxxxxxxxx) :contentReference[oaicite:3]{index=3}
>
> • Community hype thread pitching Grok as the leaderboard champ:
> 👉 [https://x.com/AlphaArenaXcom/status/xxxxxxxxx](https://x.com/AlphaArenaXcom/status/xxxxxxxxx) :contentReference[oaicite:4]{index=4}
---
### Author:  [@sams-club](https://jtechforums.org/u/sams-club)
#### Post date: [December 30, 2025, 4:53am UTC](https://jtechforums.org/t/groq-and-grok/6288/8 "2025-12-30T04:53:47Z")
i agree i hate groq
---
### Author:  [@DaWelch](https://jtechforums.org/u/DaWelch)
#### Post date: [December 30, 2025, 10:22pm UTC](https://jtechforums.org/t/groq-and-grok/6288/9 "2025-12-30T22:22:43Z")
> [@sams-club](#):
>
> groq
You hate Gro **Q** , or Gro **k**? There’s a massive difference. They don’t even do the same thing
---
### Author:  [@YourMenahel](https://jtechforums.org/u/YourMenahel)
#### Post date: [December 31, 2025, 12:50am UTC](https://jtechforums.org/t/groq-and-grok/6288/10 "2025-12-31T00:50:22Z")
Grok is only good for its unfiltered-ness
---
### Author:  [@TripleU](https://jtechforums.org/u/TripleU)
#### Post date: [December 31, 2025, 1:11am UTC](https://jtechforums.org/t/groq-and-grok/6288/11 "2025-12-31T01:11:10Z")
> [@YourMenahel](#):
>
> Grok is only good for its unfiltered-ness
Ah, mechahitler stuff… Unfilteredness - like Joe Rogan and Ian Carroll, isn’t good. Listen to ben.
---
### Author:  [@ys770](https://jtechforums.org/u/ys770)
#### Post date: [December 31, 2025, 2:38am UTC](https://jtechforums.org/t/groq-and-grok/6288/12 "2025-12-31T02:38:21Z")
I guess your groyper days are over… 🙂
---
### Author:  [@TripleU](https://jtechforums.org/u/TripleU)
#### Post date: [December 31, 2025, 2:54am UTC](https://jtechforums.org/t/groq-and-grok/6288/13 "2025-12-31T02:54:36Z")
> **for bored people**
>
> > [@ys770](#):
> >
> > I guess your groyper days are over… 🙂
>
> My opinion is: I like the Groyper movement. They are right. The Zios are controlling our government. Why does Jack Smith from Kentucky have to send his son to die in the Iraq war—for a foreign country? Like, why are all bad socialists like Bernie Sanders, Chuck Schumer, Adam Schiff, Jerry Nadler, J.B. Pritzker, etc., all Jewish politicians and causing problems? Why does the USA not care about Finland but yes about Israel? We want their tech? That’s nothing—be good with China for better tech. You want a safehouse in the Middle East? Qatar and Saudi Arabia are happy to provide. Why is the USA intertwined with Israel?
>
> Those questions are real and valid. I like Nick Fuentes—he wouldn’t fall into the rabbit hole like Candace, Ian Carroll, Stew Peters, Tucker Carlson. He never falls for crap. He’s a real America First.
>
> But at the end of the day, I am Jewish. I do know the fact that us Orthodox Jews are polar opposites to secular Jews, conservative or reform—and Zionists. We have nothing in common, and they only cause us problems.
>
> And all those influencers don’t know the difference. So openly, I cannot support them because it is unconventional suicide.
>
> So to clarify: Am I a Groyper? Yes. Can I support the current Groyper movement? No way—they don’t understand the difference between us and the bad ones, so it’s suicidal.
>
> For all questions and “arguments”—at a different time. I’m a professional at arguing and politics, and I will have an answer to everything (am I God? No, but I’m pretty confident in my unusual political stance…). So yes, don’t make this into a random forum when it’s tech-based.
---
### Author:  [@DaWelch](https://jtechforums.org/u/DaWelch)
#### Post date: [January 1, 2026, 3:14am UTC](https://jtechforums.org/t/groq-and-grok/6288/14 "2026-01-01T03:14:48Z")
I put my money where my mouth is: I just released another GroupMe AI bot. I got super sick of Copilots stupid answers and long (up to a minute) latency. So I integrated **Groq** into GroupMe for a smarter, faster AI bot. The default model is **LLaMA** but you can view other available models with the \ ***models** command and switch models by \ ***set {model}**.You can set it up [here](https://welchercorp.com/groqbot)
### Tell me what you think! PLEASE REPORT BUGS!!!
Most of all: **Enjoy!**
---
### Author:  [@Dev-in-the-BM\_2.0](https://jtechforums.org/u/Dev-in-the-BM_2.0)
#### Post date: [January 2, 2026, 6:45pm UTC](https://jtechforums.org/t/groq-and-grok/6288/15 "2026-01-02T18:45:00Z")
**The Frum Pulse** and **Newsic** are powered by Groq’s API.
Duh, their free tier.