I'm currently working on an AI alignment project where I am trying to make the case that this same truth applies to decision-making. Choices, like data interpretation, are not in the world. Two people with similar values can disagree about what values are even relevant to a given choice, or what the choice even is. And we know this is true because the same person can be influenced to make the opposite choice depending on how things are framed.
So if you want aligned AI, you can't just emulate human values, you have to understand how people come to frame choices in the first place.
Yes, absolutely. Decision framing often matters, and that decision - even when the framing doesn't fundamentally change - can still be affected by how it fits into one's psychological context at that moment (i.e., which values are activated, how other elements of the decision fit into one's life at that moment). If you don't understand the psychological context someone is bringing with them to a decision - especially a decision where there are no truly right answers - then it becomes difficult to understand how people make the choices they do.
Love this! Important read! Context is everything:)
Thanks for the kind words! Much appreciated!
I'm currently working on an AI alignment project where I am trying to make the case that this same truth applies to decision-making. Choices, like data interpretation, are not in the world. Two people with similar values can disagree about what values are even relevant to a given choice, or what the choice even is. And we know this is true because the same person can be influenced to make the opposite choice depending on how things are framed.
So if you want aligned AI, you can't just emulate human values, you have to understand how people come to frame choices in the first place.
Yes, absolutely. Decision framing often matters, and that decision - even when the framing doesn't fundamentally change - can still be affected by how it fits into one's psychological context at that moment (i.e., which values are activated, how other elements of the decision fit into one's life at that moment). If you don't understand the psychological context someone is bringing with them to a decision - especially a decision where there are no truly right answers - then it becomes difficult to understand how people make the choices they do.