Even if the women voluntarily drank alcohol and used ketamine, that does not automatically mean they consented to sexual activity. Once someone becomes significantly impaired by alcohol or drugs, the responsibility is still on the other person to recognize whether they are capable of making a meaningful decision and to stop if they are not.
The fact that someone chose to use substances does not give anyone else permission to take advantage of them while they are incapacitated. Personal responsibility matters, but so does respecting another person's ability or inability to consent.