As Other individuals have specified, the term by is mostly synonymous without any afterwards than when referring to your day or time. .. I wouldn't say "Sorry sirs, your ID's are invalid" I would prefer "Gentlemen". The only real other occasion of "Sirs" insi