"long arm of the law"

I never understood the meaning of "long arm of the law" and I continue to struggle with understanding this phrase when there are so many instances of people appearing to "get away" with bad behavior that isn't technically illegal. Are there any consequences outside the legal system? This next leads me to wonder how does a person learn what is right and what is wrong?