Samsung Galaxy Note 3 — Sync Google contact with phone

I just bought it today. All my contacts are in Google contacts. How do I get those contacts downloaded or transferred to my phone with the groups intact? When I try to sync on the phone it says syncing is not available and try back layer or it will delete my groups on Google contacts. I want Google contacts to be the host or master list. I don't want the phone to delete or change anything in Google contacts. I just want them copied down to the phone.