Re: TECH: Language Detection

OOps. Forgot to mention "stop words". Those are the
VERY most comon words in any language. Check
http://en.wikipedia.org/wiki/Stop_words

And Google for stop words lists in various languages.
These are the very words you want to do language
detection on.

This site:

http://www.ranks.nl/tools/stopwords.html

has stopwords for the following languages:

Catalan , Czech , Danish , Dutch , French , German ,
Hungarian , Italian , Norwegian , Polish , Portugese ,
Spanish , Turkish

Some English stopwords: of on or that the this to was
what when where

Some Danish stopwords: begge da de den denne der deres
det dette dig din dog du ej eller en end ene

--gary

--- Arthaey Angosii <arthaey@...> wrote:

> Since we have a fair number of programmers here, I
> figured it was a
> good place to ask my question. :)