Basically, yes.

He's helping with a fascist takeover of the country, why wouldn't they be happy?

Back in the day, Google eng had pretty unguarded access to people's gmails, calendars, etc. Then there was a news story involving a Google SRE grooming children and stalking them through their google accounts...

what was the name? and how did you possibly spend ten minutes on it

I tried many names, including just gibberish keyboard smashing, there is no way they were all already taken.

Yes, and the person you are replying to is clearly referencing Windsurf which was another vscode fork...

It was the classic "oh no we did caching wrong" bug that many startups bump into. It didn't expose actual conversations though, only their titles: https://openai.com/index/march-20-chatgpt-outage/

ah there it is. thanks for jogging my memory. funny to think of how niche chatgpt was considered then to now.

The extra system prompt can definitely cause some performance issues, and it can over use them. The deleting every line behavior is gone though. It's definitely not something you should turn on for every conversation, but it's quite compelling for creating little capsule web apps.

Coming up with accurate financial data that you can't get it to report outright doesn't seem like one.

Models do not possess awareness of their training data. Also you are taking at face value that it is "accurate".

I don't understand the wording

Accurate financial data?

How do we know?

What does using not-web-search not having the data have to do with the claim that private chats with the data are being leaked?

> I found this company; it is real and numbers in the response are real.

???

That the financial data is accurate?

It's an ourobos - he can't verify it's real! If he can, its online and available by search.

Therefore what are the odds that this is just the LLM doing its thing versus "a vulnerability". Seem like a pretty obvious bet.

Have you heard of TPUs?

Sort of a hardware advancement. I'd say it's more of a sidegrade between different types of well-established processor. Take out a couple cores, put in some extra wide matrix units with accumulators, watch the neural nets fly.

But I want to point out that going from CPU to TPU is basically the opposite of a Moore's law improvement.

Yeah, I'm a regular Joe. How do I get one and how much does it cost?

If your goal is "a TPU" then you buy a mac or anything labeled Copilot+. You'll need about $600. RAM is likely to be your main limit.

(A mid to high end GPU can get similar or better performance but it's a lot harder to get more RAM.)

I want something I can put in my own PC. GPUs are utterly insane in pricing, since for the good stuff you need at least 16GB but probably a lot more.

9060 XT 16GB, $360

5060 Ti 16GB, $450

If you want more than 16GB, that's when it gets bad.

And you should be able to get two and load half your model into each. It should be about the same speed as if a single card had 32GB.

> And you should be able to get two and load half your model into each. It should be about the same speed as if a single card had 32GB.

This seems super duper expensive and not really supported by the more reasonably priced Nvidia cards, though. SLI is deprecated, NVLink isn't available everywhere, etc.

No, no, nothing like that.

Every layer of an LLM runs separately and sequentially, and there isn't much data transfer between layers. If you wanted to, you could put each layer on a separate GPU with no real penalty. A single request will only run on one GPU at a time, so it won't go faster than a single GPU with a big RAM upgrade, but it won't go slower either.

Interesting, thank you for the feedback, it's definitely worth looking into!

$500 if you catch a sale at Costco or Best Buy!