In this paper, an interactive model for individual normal behaviour of drivers is presented in which the mutual effect of vehicles has been incorporated. Temporal features obtained from vehicles tracking and their motion history is utilized for generating a model of normal behaviour. Because of non-stationarity of behaviour, Hidden Markov Model has been used for interactive model. This model has three main parts. The first part is the history of antecedent trajectory which for this purpose has proposed a Centers Transition Matrix (CTM) that is some type of spatio-temporal information-data bank from motions seen in the old frames. The second part is based on the linguistic features or motion recognition of vehicles, these motions contain forward, turn right and left, lane changing to right and left motion. The third part is constituted from low level features which contain Velocity and distance to neighbor object. Also CTM is efficient in search at similar blob in image sequences and it can determine the radius and region of search. This top-down feedback caused an increment of performance of RLS tracker and object searching. In the presented system, we obtained a 81.2% membership rate to normal model. Also types of motion are recognized using HMM with a recognition rate of up to 82.7%. Prediction error is reduced on many vehicles trajectory by at least 80% using a feedback system.