Usually, models of the intellect take the individual mind and body as the point of departure and proceed outward towards the social and natural environment in which the individual is immersed. As a consequence, important social dimensions contributing to the epigenetic development of the individual is less articulated. In this contribution, I suggest to model the intellect from a more balanced perspective that recognizes both social and individual aspects – the coordination of actions. I argue that coordination is made possible by certain innate dispositions that I call activity modalities: contextualization, spatialization, temporalization, stabilization, and transition. Consequently, a central task for modeling the intellect is to understand how perceptions received through sensory modalities are related to the activity modalities. To this end, I propose a research program for modeling the intellect, based on the concept of “activity” in the Russian Activity Theory and the activity models. Provisional arguments for the relevance of the activity modalities are discussed in three different realms associated with the intellect: the social, conceptual, and neural ones. The chapter is concluded with some preliminary research questions, pertinent for the research program