If your saw isn't cutting straight, answer "Yes".
A correctly tensioned chain should:
1Be in contact with the underside of the guide bar (not hang freely under the guide bar)
2You can pull it around easily by hand.