If you logged into your Google Account on your phone instead of a google application you can follow the following steps to remove it.

  1. Open your settings app.
  2. Tap "Accounts". Depending on your phone this may be in a sub section or called something else (EG: "Users & Accounts"). You can always search for it within your settings app.
  3. If your account is listed click on it and click "Remove account". If the account isn't listed then your account has already been successfully removed.

You may need to enter your phones PIN/Passcode during the process.