Say the blessing if you intend to smell something fragrant; you may, but do not need to, say a blessing if you smell a scent in passing.  If you are outdoors and a pleasant scent of flowers comes to you, even if you did not intend to smell the flowers, as long as you enjoy the scent, you may still say the appropriate blessing.