Yes, you need to update the name of company on various places such as the name board of the company, letterheads, business letters, invoices, bills of exchange and other documents. The name also needs to be updated on PAN, TAN, GST Certificate, MSME certificate, Bank Account etc.