Information theory is about quantifying and qualifying the content of an information in a data set.

Basically, it means that for a specific dataset I could say which data is interesting or not (according to the algorithm I use).

It is used in information retrieval (IR).

I should have started with that maybe��

Actually, I made mistake talking about information theory, it is more about information retrieval (my bad..). However, with the Moose-Algo-Information-Retrieval, I have only a set of words that is used in documents but I would like to know if there was an effort on any algorithm to qualify these words ?�

There different kinds of model:

- set-theoretic model

-�documents are represented as set of words or phrases and similarity derives from the set-theoretic operations on those sets (I don�t understand so much this one for now..)

- Common techniques are Boolean Model (several kinds) and Fuzzy Retrieval

- algebraic model

-�documents and queries are represented as vectors (or matrices or tuples) and similarity is computed between query and document thanks to this representation�

- Common techniques are Latent Semantic Indexing (LSI), Vector Space Model (several kinds)

- probabilistic model�

-�there is no particular representation for documents here. Similarity is computed using the probability the document is relavant for the query

- Common techniques are Latent Dirichlet Allocation or others

I�m more about using an algebraic model and maybe is there something on Latent Semantic Indexing?

I�m not sure, I explained my thinking well ��

Regards,

--------------

Brice Govin�
PhD student in RMoD research team at INRIA Lille�
Software Engineer at THALES AIR SYSTEMS Rungis
ENSTA-Bretagne ENSI2014
22 Avenue du General Leclerc 92340 BOURG-LA-REINE

On 15 Jun 2016, at 22:54, Alexandre Bergel <alexandre.bergel@me.com> wrote:

Yes, tell us more.�
This is an interesting topic

Alexandre

--�
_,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:
Alexandre Bergel �http://www.bergel.eu
^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

On Jun 15, 2016, at 4:38 PM, stepharo <stepharo@free.fr> wrote:

Le 15/6/16 � 19:03, Brice GOVIN a �crit�:

Hi,
I'd like to know if someone did a work on information theory algorithm ?

tell us more.
What is it?

I saw a package in Moose about information theory but it is just a kind of document indexation.

Is there something more complete (quantities information)?

Thanks,

--------------

Brice Govin�
PhD student in RMoD research team at INRIA Lille�
Software Engineer at THALES AIR SYSTEMS Rungis
ENSTA-Bretagne ENSI2014
22 Avenue du General Leclerc 92340 BOURG-LA-REINE