This paper outlines the theoretical background and presents a new approach to human body tracking with monocular static camera. A novel “view-based representation” is introduced at the feature extraction stage. We show that ambiguities in correspondence, such as the ones that occur as the result of occlusion, can be resolved by using this approach. In particular, we store color information for each object in a vector of views, where the number of elements is determined online, using unsupervised clustering followed by the cluster validity assessment. Based on this representation a tracking system was developed. The preliminary results presented show the discriminative potential of the proposed system.