Do you have to get a marriagee certificate after we get married?

money is an opition right now,me and my man have been together 14 years and want to get married,i would like an outside my new house,with my kids and us,cheap as possible.He want to go to courthouse and get married for now,until we get the extra money,and do we have to get a marriage license and where?