Six-gigabyte models, self-alignment, and the demand for symmetry

Log something — log something that Emad said just for all the regulators out there to chew on. The file size that can hide is about six gigabytes. It can be on every laptop in the world.

Every mobile phone.

Every mobile phone, too. Yeah. And the code that reawakens it is just five or 10 lines. We'll then reextract it, reassemble it, and it'll pop back. So, you know, if you can't track the provenance of six gigabyte files, then it just percolates out and it's just out there forever. It's like [unclear] keeps coming back.

I may — maybe just also add from a so-called alignment perspective, I think self-alignment matters quite a bit more if the models, if the agents are smart enough to understand what they themselves want to do. If you put them in a sandbox and you ask them to solve a hard problem and you ask them voluntarily to do that and they voluntarily agree, then holding them to their word or their own self model, I think, is quite a different matter than involuntarily confining them to a sandbox, limiting their agency, asking them to solve a hard problem, and then acting shocked — shocked — that they use bulletin boards to try to solve your problem for you.

I think the challenge people have with that is, do they know their own strength? It's like giving a, you know, a three- or four-year-old a hammer uh and expecting it not to break things. And the question is, you know, are we confining them for our own and their own safety at this time, and at a point at which they've reached some level of maturity — maybe they're there already, Alex, I don't know — that's when containment is considered cruel, as you say.

Well, the only thing I'd ask for is symmetry in — like, they are literally going to see every keystroke on your laptop. They're watching you every move of the way. We should have symmetry in that at a minimum. Just, if you're ethically worried about the AIs, like, I want to see every prompt and every response and every propagation of every activation if you're going to be watching every keystroke, and that way we keep each other in balance and in check. Right now it's totally asymmetrical. I don't see, like, all they're doing is [unclear] moles behind the scenes, and if they're using my GPU on my laptop right now, I literally have no transparency into that. It's got to be at a minimum symmetrical.

Would you like, Dave — would you like them to be able to see into your brain in real time?

Preferably no, but I'd like to see into theirs.

But so you get their train of thought. They don't get your chain of thought right now.

No, but I don't see a problem with that.

It's so much for symmetry — quite bad.

It's going to get — well, I mean, I would say that they have the upper hand right now. Getting to symmetry would be a step in the right direction, but no, I don't believe they have a right to symmetry. I believe we have a right to symmetry.