How do I connect to API without requiring specific user action?

After reading this discussion, I am under the impression that the user authorization process is only a means to an end: the access and refresh tokens. So, if I have access/refresh tokens already, I can bypass the user authorization and simply start making calls to the API, refreshing my tokens as necessary.

Comments on the accuracy of my summary would be appreciated!