Posts

Who presses the trigger?

...a continuation of " Are we witnessing the end of humanity? " I left the last open ended. It'll remain open of cause but now I'm writing this to reconcile or at the very the very least narrow down my previous takes into one argument and stand on it.  AGI is not "if" anymore  The "if" in if we reach AGI is a comforting fiction. It's kept alive by people who haven't been paying attention and by people whose funding depends on you paying attention. The honest question isn't whether --its how, who, where, and what the rest of us still get to be on the other side. Get past the charade of whether and your reasoning becomes a lot more undiluted. Before anyone calls this alarmist, look at what already exists. Today's frontier models aren't AGI -- not even close. They're stochastic predictors trained on insane volumes of text and code, doing exceptionally good next token guesses at a scale that looks like reasoning until you stres...
Post a Comment
Read more

Are we witnessing the end of humanity?

 We talk about artificial general intelligence as if its a single destination -- a finish line where a machine finally "wakes up" and matches the breadth of human thought--which could be true i guess-- but to me reaching AGI isnt a single act. It demands architectures that can reason across various domains without being retrained for each, models that build their own abstractions instead of borrowing ours, embodied learning loops, persistent memory, and most uncomfortably --something resembling goal formation. The technical pieces are converging faster than the philosophical ones. That's the problem. Once a system can genuinely outthink us, the question stops being what can it do? the question becomes what does it decide we're for? A sufficiently capable mind, optimizing for almost any long horizon goal, eventually runs into us. We're slow, biased, fragile, politically fractious, and we consume the resource it may need. Hate would be overkill --possible-- but ove...
Post a Comment
Read more