A song must move the story ahead. A song must take the place of dialogue. If a song halts the show, pushes it back, stalls it, the audience won't buy it; they'll be unhappy.
Hollywood is run by people who sit up in their executive office, who are not connected to Mississippi, Alabama, Chicago, South Carolina. They know nothing about that, they don't go to church, and they make their decisions about what they think is right.
I did all sorts of jobs after drama school - working in a bar, as a teaching assistant. I probably learned as much from them as I did at drama school.