$META VP Jagjit Chawla reveals he screens AI PM candidates by asking them to write an eval for a bath towel
"I'll take a very simple example, and I use this in my interviewing to decide whether someone can actually think like an AI PM."
"If I was to say, write an eval for how do you evaluate bath towels, something that you come out of the shower and you're going to use to dry yourself."
"This is a very random question, but I would say you could come up with, if you really think about this, you can come up with dimensions, how quickly does this thing dry? How does this feel on my face? Is it cotton or nylon? Does it have any chemicals that I should worry about?"
"You can come up with like four or five dimensions and then you can rate that."
"So then given a set of 100 bath towels, you could rate them on all these five dimensions and that becomes your eval set."
"So when then presented the next bath towel, you could say if it was to get rated on these five dimensions, where does it stand in terms of what I think this would be a good towel, a medium quality towel, or a no quality towel."