does it go on your medical record? can people hold that against you when applying for things? jobs? careers?

NO!
Medical records are absolutly confidential; in order for a doctor to release any information to anyone, you must sign a release form.