Raw LLM Responses

Wolfram sums up by saying he is an optimist. That is as vague and dodgy as saying "I believe in the rapture". In both cases, ridiculously unrealistic. Computers have been dictating to us since the 60s when they were totally dumb. We have organised our societies around depdendence on them and the associated needs of powering and repairing and building more of them and continually improving their designs. We may have backed ourselves into a corner by doing so. Because they lead to human greed ruthlessly exploiting them for gain at the expense of other humans. Can't blame the machines. It's always humans to blame, so far. But we aren't our own best advocates, we continually sell ourselves short. We discount the future because we won't be in it. We neglect the interests of our descendants. Look at behaviours of psychopaths who have hijacked the resources of entire continents for their own individual aggrandisement and ego, such as Putin and Trump, or on a lesser scale Kim and Khamenei and Gaddafi and Assad and many others. That should give us some insight into what happens when micro-optimisation (pursuing the goal of one individual or faction) trumps macro-optimisation (the goal of supporting the needs of the proletarian majority who have very little power and can therefore be ignored unless they start to rebel out of desperation). Every goal we give to an AI will be a micro-optimisation. (The paper-clip optimiser idea.) Look at psychopaths and big corporations for examples of what goes wrong when the feedback loops are connected such as to ensure a specific micro-optimisation rather than a global macro-optimisation. And a small number of individuals get to choose those optimisations, discounting the will of others.