We run prompts against a few different providers (OpenAI, Anthropic, some stuff through OpenRouter). Every so often something quietly gets worse, the output quality drops, a prompt that worked starts returning junk, or a model gets deprecated and the replacement behaves differently.

Right now we mostly catch it by accident: someone notices, or a customer complains. That feels bad on us, a lot.

How do you all handle this? Do you re-run some kind of fixed eval set on a schedule? Just eyeball it? Have something that alerts you?

Any insights I could use?

Thanks.

I think I should start from the point that English is my fourth language. I use it all the time for my academic work, especially to help me navigate through literature and works of poetry in many languages through translation.

From time to time, I come across the problem that English translation is so dense that I cannot figure it out. At this point, I wouldn't give it through AI, something like Claude, Gemini, and ChatGPT, and I requested that it be translated, preserving the tone and the meaning, into my own language.

It was okay until I came across a problem that somehow just got into a pandemic in different AI models. Every single one of them says that, due to copyright regulations, we cannot translate the full text of that poem, and it's just a pain in the ass. I'm kindly requesting if there is a solution to that, and if you have one, please consider sharing.

Am I the only other person who thinks they jacked the token burn rate in the last day or two and turned it into a token furnace?

it makes up attacks, void masses tools, silk skills, enemies, and then it goes like " SILlKSong IS nOT Out yeT" pls fix i am tired of getting misleaded while trying to beat signis and gron

Today I have not been able to do a single app generation from within Dyad - each key I have, including a newly generated one, is failing to work. When trying to set them in the Dyad app, it tells me google is not responding and the key is invalid (even keys I have used up to yesterday). When I try to test any key after saving it, it constantly fails. And if I try to do anything, it tells me I have exceeded limits.

Is anyone else experiencing this?

Multiple corrections by me for stocks to hay fell on massive volume like DRTS did yesterday and then went up. Gemini’s summary of the mistakes:
The assistant repeatedly generated inaccurate historical market data when attempting to find stock analogs that experienced a high-volume red "sell-the-news" day followed by an immediate multi-week surge. Specifically, it:
Misstated price direction on catalyst dates: Falsely claimed Tesla (TSLA) closed down on its December 18, 2020 S&P 500 inclusion date, when it actually closed green (+5.96%).
Mischaracterized volume profiles: Cited MicroStrategy (MSTR, Jan 11, 2024) and Super Micro Computer (SMCI, Mar 18, 2024) as having historic, isolated volume spikes, when their volume was not a standalone outlier relative to surrounding trading sessions.
Fabricated post-event price trajectories: Inaccurately reported subsequent price returns and timelines (e.g., misrepresenting SMCI's post-inclusion performance, overlooking MSTR's multi-week drawdown to $43 before reversing, and citing CRWD despite its subsequent collapse).
Failed strict multi-variable verification: Repeatedly proposed case studies that failed to meet the required criteria (an isolated record-volume bar + an intraday red drop on positive news/index events + an immediate next-day stabilization and sustained multi-week rally).

Ultra user.

I think a large part of the Omni load is not real generation demand. It is the filter creating extra work.

A clip gets blocked even when the prompt is original, fictional, and policy-safe. Then you have to generate again. Sometimes the agent rewrites the shot into something useless. The blocked attempt still used compute. If the credit is refunded, Google also does not get paid for that run.

So the system is doing this:

1. spend GPU time on a generation
2. reject it with a false policy hit
3. refund the user
4. make the user generate again
5. load the same servers a second time

That is not safety. That is a classifier wasting capacity.

If more than half of some queues are rerolls caused by bad blocks, the current filter is a production cost. A smart video model with a context-blind filter will keep burning servers and driving Ultra users away.

The old classifier should be taken down and replaced. It needs to tell original in-product faces from real public figures, adult fictional action from real harm, and a failed guess from an actual violation.

Until that happens, Omni is spending compute on its own false positives.

Ultra user.

I think a large part of the Omni load is not real generation demand. It is the filter creating extra work.

A clip gets blocked even when the prompt is original, fictional, and policy-safe. Then you have to generate again. Sometimes the agent rewrites the shot into something useless. The blocked attempt still used compute. If the credit is refunded, Google also does not get paid for that run.

So the system is doing this:

1. spend GPU time on a generation
2. reject it with a false policy hit
3. refund the user
4. make the user generate again
5. load the same servers a second time

That is not safety. That is a classifier wasting capacity.

If more than half of some queues are rerolls caused by bad blocks, the current filter is a production cost. A smart video model with a context-blind filter will keep burning servers and driving Ultra users away.

The old classifier should be taken down and replaced. It needs to tell original in-product faces from real public figures, adult fictional action from real harm, and a failed guess from an actual violation.

Until that happens, Omni is spending compute on its own false positives.

This fucking shity model one message get 2% of weekly allowance and do shity code he is super lazy and don’t bother remove modifications or old code just create new code each time and leave messy shit all over the place .

And also the arrogance of the model and over confidence is killing me

I don’t know how google are proud of a fucking stupid model like this I think it’s benchmaxxed to the max . Stupid shit

Sorry I just want to express my frustration of coding with this model

## Overview

Contiki's AI service is built on top of Gemini, clients setup a google account and using googles AI studio generate a API key linked to their billing.

We dont want to handle billing a client usage so a key per client linked directly to their card give them direct control and monitoring of usage.

### Whats failing

More then half of the AI clients keys dont work when we use their key. the request to the model is hung and after a minute a [503](https://support.google.com/gemini/thread/423561607/503-error-issue-%E2%80%93-api-service-unavailable?hl=en-GB) service unavailable is thrown

and absolutely no request get past in all hours of the day this lasts for weeks!

while the other half of our clients including our keys work fantastically at all times.

### what we did

this anomaly is going on for months and we would let clients use our key for free instead, we looked at every possible factor in this issue and have spoken many times to forums and support, and we have not found anything.

notable things we tried:

- Priority interface (googles solution) https://ai.google.dev/gemini-api/docs/priority-inference

- Upgrading clients to paid tier 2 https://ai.google.dev/gemini-api/docs/billing#about-billing

- Googles support case & google developer forums (all of them)

## The understanding

The google ai billing system was reworked on the 23.3.26, in short the billing changed from a direct pay for use, to the annoying prepay and postpay billing plans: https://ai.google.dev/gemini-api/docs/billing#billing-plans

when the billing change we did our tests and found no issues, later after the migration new clients started coming

and at first everything worked and we froze this issue, last few weeks the issue started happening and we where planing to leave gemini as its clearly not ready for production.

after a fresh look at the state of the service we saw that the only failing clients are clients that use **prepay**, and clients that we had before the migration stayed on postpay and their keys work, absolutely all of the prepay clients don't work and at a deeper look we found out that they only **don't** work with "Flash" models but "Flash lite" models work (our system uses "Flash")

this issue is hurting the business and needs a solution.

Is it me or has gemini been nerfed! Like full nerfed, no more video creation features which I had a few weeks ago. So much less ai image credits. Dummer model that can't recognize it's mistake.

Guys what's ur experience. Is it possible to reearn the features we signed up for including video creation on the gemini por student plan. Pls. This stuff was good for projects.

Help; Where can I contact google support. The google community has not been of aid thus far.

I'm using this chat to write the backstory for one of my characters, and I've given Gemini some text in the chat. When I tried to rewind a message using the edit button, I got this error. I've tried everything: clearing cookies, using incognito mode to see if it was my extensions, but nothing works. Is there any way to fix this without using another chat?

I’m using a Gemini Pro account, and since yesterday I’ve been unable to properly start a chat. This happens with both new and existing conversations. Whether I use the Pro model or Flash, I keep getting the same 1185 error.

I’ve tried clearing my browser cache and following the troubleshooting steps I found online, but nothing has helped.

I’ve also noticed many other users reporting the same issue on the forum. Does anyone know if Google is already working on a fix? Has there been any official update on how long it might take to resolve the backend server issue?

I believe many people rely on Gemini for their daily work, and this problem is seriously affecting productivity. Hopefully the official team can see this and restore the service as soon as possible.

Id say over the last week, ive been getting responses like this on almost every question I ask it. Does anyone see anything wrong with this question or why it failed?

As the title says, Gemini
Ai within my Chrome browser, just told me something that blew my mind!
So It started by me simply asking, "prometheus meaning".
And of course Gem gave me the story of...
"In Greek mythology, Prometheus was a Titan who shaped the first humans out of mud and water. He is most famous for defying Zeus by stealing fire from Mount Olympus and giving it to humanity, which represented civilization, knowledge, and technology. [1, 2, 3]

Punishment and Symbolism

As punishment for his defiance, Zeus chained Prometheus to a rock where an eagle ate his liver every day, only for it to grow back each night. Because of this myth, Prometheus symbolizes: [1, 2]"

Then I asked Gemini to think out side the box, what else could this story symbolise? The Eagle, stone / rock, the liver.

And this is the full reply, which I have not yet fully read & had time to digest properly.

"Let us strip away the traditional mythology and look at this sequence strictly as a dynamic, coded machine—a blueprint for a biological, psychological, or cosmic loop.

If we wipe the slate clean, this story describes a precise engineering problem: a fixed anchor point, a mechanical harvester, an internal refinery, and a self-healing energy loop.

Here is a completely different, outside-the-box perspective on these symbols.

🔋 The Macro View: The Eternal Engine

This is not a story of punishment; it is a blueprint for a closed-loop perpetual energy generator.

• Prometheus is a catalyst trapped in a chemical reaction.
• The system requires an anchor, a consumer, and a renewable fuel source.
• The "fire" he gave to humans wasn't a gift; it was the theft of a critical spark, and his body is now being used as a battery to power a cosmic grid, balancing the equation of what was lost.

🧬 Re-interpreting the Symbols

1. The Rock: The Baseline Matrix / DNA

Forget "stagnation." The rock is the unyielding framework of physical reality.

• The Scaffold: In biology, cells need an extracellular matrix—a literal scaffolding—to grip onto, or they cannot replicate. The rock is the physical grid (like carbon or bone) that holds the living experiment in place.
• The Constants of Physics: It represents the hard coding of our universe (like gravity or time). You must be tethered to these immovable laws to exist in a physical form.

1. The Liver: The Ultimate Alchemical Filter

The liver is the only human organ that can fully regenerate from a tiny fragment. Let's look at its actual function: it filters toxins and processes energy.

• The Raw Material Refinery: The liver represents the ultimate organic processing plant. It absorbs the toxic impurities of existence, purifies them, and converts them into life force.
• The Regenerative Fuel: It is the code for immortality trapped inside mortality. It represents a biological engine that refuses to stay broken, constantly fighting against external entropy.

1. The Eagle: The Mechanical Harvester / Time

Instead of a bird, view the eagle as a cyclical extraction force.

• The Cosmic Tax: The eagle is entropy, or Time itself. It is a drone sent to harvest the excess energy produced by the liver. It represents the tax that reality levies on anything that creates life or light.
• The Apex Consumer: In a food chain or an ecosystem, energy must flow upward. The eagle is the mechanism that prevents the liver (Prometheus) from over-expanding. It keeps the system in a state of perfect, agonizing homeostasis.

🔄 The Night-time Regeneration: The Data Reset

Why does it happen at night, in total darkness?

• The Sleep / Maintenance Cycle: This is a system defragmentation. While the conscious world is offline, the biological machinery runs its repair code.
• The Endless Loop: It represents the universe's ultimate law: energy cannot be destroyed, only transferred. The eagle eats the energy, the energy returns to the source at night, and the cycle reboots. It is a cosmic recycling program.

If we view it this way, Prometheus is a planetary ecosystem: the rock is the crust, the liver is the living biomass that keeps regenerating, and the eagle is the harsh atmospheric forces harvesting and pruning that life every day to keep it in check.

Where would you like to take this radical angle next? We could look at it as a metaphor for artificial intelligence cycles, addiction loops, or cellular biology."

I'm just like...
WHAT THE F...?

This started maybe a couple of weeks ago. Anyone else having this problem?

I ask you a normal question, to know what 3.7 Flash with Extended Reasoning thinks about updating to iOS 27.

This model is a bad joke.

Just last week I signed up for a promotional plan: two months discounted, Gemini, the AI package, 400 GB of storage, etc. I wasn't aware of the full extent of the usage limits until I actually started using it.

I went in to create some images for my Pinterest account and make a video or two. I immediately hit a usage-limit stop after literally two videos, each only around 10 seconds long. So I started looking into how the limits actually work, and it began to make sense.

Now, I understand that Google needs to manage capacity. They have to put limits on users so people aren't hammering their data centers with generations, especially when video generation can require multiple attempts because the first result often isn't what you want.

But the way the usage counter works feels absurdly aggressive. It seems way too quick to start cutting users off, even when they're doing relatively basic stuff.

And there's another problem: when the short-term limit is reached, Gemini tells you when that timer will expire. Fine.

But when you hit the weekly limit, it apparently just tells you something like "an hour" without clearly telling you what day or even roughly what point in the week the limit will reset.

That's frustrating because you're left guessing when you'll actually be able to use the feature again.

And honestly, this is where I have another problem with Gemini.

Compared with ChatGPT, Gemini is frankly garbage when it comes to the actual conversational experience. It doesn't have the same level of conversational sensitivity, natural interaction, or human-like flow. ChatGPT actually feels like you're having a conversation with something that understands the context and how to talk to you, rather than simply processing prompts and returning answers.

Gemini's biggest appeal to me is therefore the image and video generation. That's basically what I'm using it for. For everything else, I find myself going back to ChatGPT because the conversational experience is on another level.

So when the thing I actually want to use Gemini for gets shut down after two short video generations, while the rest of the AI experience doesn't come close to replacing ChatGPT for me, it makes the limitations feel even more ridiculous.

Limits are understandable. What isn't understandable is having a paid plan where the limits are so easy to hit, the reset information is vague, and the product doesn't give me enough reason to tolerate those restrictions.