You can only set it up with one Google Account. And anyone that can talk to it and give it the proper commands, "Hey Google, play playlist XXX from Google Music" can listen to your music from Google Play Music. Doesn't matter if your phone is around or not.