Keeping Track of What You Watch