If you let a bully come in your front yard, he'll be on your porch the next day and the day after that he'll rape your wife in your own bed.
The real problem is deflation. That is the opposite of inflation but equally serious to the borrower.