Berkeley's immaterialism aims to undermine Descartes's skeptical arguments by denying that the connection between sensory perception and reality is contingent. However, this seems to undermine Berkeley's (alleged) defense of commonsense by failing to recognize the existence of objects not presently perceived by humans. I argue that this problem can be solved by means of two neglected Berkeleian doctrines: the status of the world as "a most coherent, instructive, and entertaining Discourse" which is 'spoken' by God (Siris, sect. 254) and the nature of language as a public social practice. Together these doctrines entail that ordinary physical objects, including those that are not presently perceived, are a joing product of divine discursive activity and human interpretive activity.