Book: 20260929 to 20261004, "If Anyone Builds It, Everyone Dies" by Eliezer Yudkowsky and Nate Soares
20260929 - Introduction: Hard Calls and Easy Calls PART I: NONHUMAN MINDS 20260930 - Chapter 1: Humanity’s Special Power Individual chimpanzees sometimes kill individual humans, but there is a reason why our species is trying to protect their species from being accidentally extinguished. p28 Good point! 20260930 - Chapter 2: Grown, Not Crafted, 30 20260930 - Chapter 3: Learning to Want 20260930 - Chapter 4: You Don’t Get What You Train For, 46 Such an alien might reason that, if hominids evolved more intelligence, built higher technology, and so gained access to a wider space of possible foods that super-hominids could create, then they'd love the taste of gasoline. Or better yet, jet fuel. p49 Why this didn't happen? But gradient descent works directly on every part of a large mind that it's tuning, whereas natural selection tunes small genomes that work as a sort of recipe for a large brain. p53 What does this mean? You can't grow an AI that does what yo...