It's a real word (a compound word fromed from kalsari(t) (underwear) and känni (drunkenness), both rather colloquial versions of these words) and can be found in the online dictionary of the Institute for the Languages of Finland (the institute in charge of standardization of languages used in Finland). The word is described as:
kalsarikänni ark. humalahakuisesta kotona juomisesta alushoususillaan t. muuten rennosti pukeutuneena. Otti kalsarikännit.
Translated to English: "drinking at home in your underwear or otherwise casually dressed, with intent of getting drunk".
The institute is also holding a Suomen sana -kipailu (The Word of Finland - competition). While there isn't yet a winner, 10 finalists were already selected from a list of publicly proposed words and kalsarikännit is included in the finalists. The selection was done by "Kotuksen asiantuntijat" (English: experts of the institute). I'd recon this would exclude any fake words from being in the top 10.
Other compound words found in the top 10 would be sinivalkoinen (blue and white, or, through reference to the Finnish flag, adjective for finnish) and demokratiavaje (democracy deficit, a term coined by those unhappy with Finland's role in EU decition making).
