2 Comments
⭠ Return to thread

I think in most of these a single overmind is assumed. Seems likely there could be many AGI agents competing with each other, with different goals. Wars will be fought within our infrastructure between those that exploit and those that defend. Different agents will accumulate more resources than others, and then others will take those resources too. What does a world of not one AGI, but thousands, millions of competing goals look like?

Expand full comment

I think there are economies of scale / network effects that push towards a single overmind. As an analogy look at how much bigger/valuable Tech companies are relative to Retail, or other traditional industries. Tech has higher returns to scale, requires fewer employees, and has less diseconomies of scale so you see more concentrations / less fragmentation. I think you extrapolate out to AI and the same trends are likely to continue which is why a lot of these analyses assume a single overmind.

That being said, it would be interesting to explore more of what a world with multiple competing AGIs would look like.

Expand full comment