According to Google, what you suggest "Canonical tag must point to the starting page" is wrong.
In this page, it reads:
Don't use the first page of a paginated sequence as the canonical page. Instead, give each page in its own canonical URL.
And I'd say it makes sense. I mean, each page has different content.