From my experience of living in those days with people her age, her fans, and in that culture, the exact translation of, "everybody is down on me," would be, "Everybody is upset with me."
Their response to her would have made her feel 'down', or 'sad'.
Had she done something while drunk or drugged, that she was now ashamed of, and was being punished by others (through shunning, curt remarks, cancelled appointments, angry fan mail), she would feel 'down', and would say 'they are down on me', to bring her own feeling of 'down' into their feelings about her. It was an expression created by those expressing feelings while high.