C. Bourjot, V. [. Chevrier, V. Bourjot, V. Chevrier, . L. Thomas-[-bdc98-]-f et al., Multi-agent simulation in biology : application to social spiders case Agent Based Simulation Workshop II A new swarm mechanism based on social spiders colonies : from web weaving to region detection. Web Intelligence and Agent Systems Un modèle multi-agents pour la simulation en agronomie : usages et comparaisons, Actes des 6èmes Journées Francophones IAD-SMA, 1998. [BDT99] E. Bonabeau, M. Dorigo, and G. Theraulaz. Swarm Intelligence : From Natural to Articial Systems, p.18234764, 1999.

D. Bernstein, R. Givan, N. Immerman, S. [. Zilberstein, G. Bonabeau et al., Sequential optimality and coordination in multiagent systems Bisognin and S. Pesty. Emotions et systèmes multi-agents : une architecture d'agents émotionnels Journées francophones des Systèmes multi-Agents JFSMA Swarm intelligence Mathematical models of selforganizing hierarchies in animal societies Une double approche modulaire de l'apprentissage par renforcement pour des agents intelligents adaptatifs, IJCAI '99 : Proceedings of the Sixteenth International Joint Conference on Articial Intelligence Bonabeau and G. Theraulaz. Intelligence Collective. Hermes Becker, S. Zilberstein, and V. Lesser. Decentralized markov decision processes with event-driven interactions AAMAS '04 : Proceedings of the Third International Joint Conference on Autonomous Agents and Multi Agent Systems, pp.819840-478485139, 1991.

R. Becker, S. Zilberstein, V. Lesser, and C. Goldman, Transition-independent decentralized markov decision processes, Proceedings of the second international joint conference on Autonomous agents and multiagent systems , AAMAS '03, p.4148, 2003.
DOI : 10.1145/860575.860583

. [. Bibliographie, C. Claus, and . Boutilier, The dynamics of reinforcement learning in cooperative multiagent systems, AAAI/IAAI, p.746752, 1998.

. S. Ccf-+-99-]-r, Y. Cost, T. Chen, Y. Finin, Y. Labrou et al., Modeling agent conversations with colored petri nets, Proc of the Workshop on Specifying and Implementing Conversation Policies, pp.5966-99

N. S. Camazine, J. Franks, E. Sneyd, J. L. Bonabeau, G. Deneubourg et al., Self-Organization in Biological Systems [Cha02] I. Chades. Planication distribuée dans les systèmes multi-agents à l'aide de processus décisionnels de Markov, 2001.

A. R. Cassandra, L. P. Kaelbling, J. A. Kurienckl94-]-a, L. P. Cassandra, M. L. Kaelbling et al., Acting under uncertainty : Discrete bayesian models for mobile robot navigation Acting optimally in partially observable stochastic domains, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems Proceedings of the Twelfth National Conference on Articial Intelligence (AAAI-94), p.10231028, 1994.

V. Cotel, C. Thomas, D. Bourjot, V. Desor, H. Chevrier et al., Processus cognitifs et dierenciation sociale de groupes de rats : interet de la modelisation multi-agents. 6e colloque des jeunes chercheurs en sciences cognitives The ant colony optimization meta-heuristic Steps towards multi-agent oriented programming. 1st International Workshop on Multi-Agent Systems(IWMAS'97), 1997. [DF93a] A. Drogoul and J. Ferber. From tom-thumb to the dockers : Some experiments with foraging robots. From Animals to Animats II [DF93b] A. Drogoul and J. Ferber. From tom-thumb to the dockers : Some experiments with foraging robots. From Animals to Animats II Collective patterns and decision making, New Ideas in OptimizationDiz03] A. St Dizier. Les processus décentralisés d'organisation et leurs applications potentielles . Diplome de DEa, universite Henri PoincaredKL98] M. d'Inverno, D. Kinny, and Michael Luck. Interaction protocols in agentis. IC- MAS'98, Third International Conference on Multi-Agent Systems, pp.1132-451459295311, 1989.

D. Desor, B. Krat, A. M. Toniolo, and P. Dicked, Social cognition in rats : incentive behaviour related to food supply, XXIInd Int. Ethologica conference, 1991.

E. H. Durfee, V. R. Lesser, and D. D. Corkill, Trends in cooperative distributed problem solving, IEEE Transactions on Knowledge and Data Engineering, vol.1, issue.1, p.6383, 1989.
DOI : 10.1109/69.43404

M. Dorigo, V. Maniezzo, and A. Colorni, Ant system: optimization by a colony of cooperating agents, IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), vol.26, issue.1, p.2941, 1996.
DOI : 10.1109/3477.484436

M. [. Dutech, ]. Samuelidesdt92, A. M. Desor, and . Toniolo, Apprentissage par renforcement pour les processus décisionnels de markov partiellement observés Revue d'Intelligence Articielle Incentive behaviour in structure groups of rats : about the possible occurence of socio-cognitive processes. Comparative approach in sciences cognitives, 1992.

]. A. Dvb-+-01, G. Dury, C. Vakanas, V. Bourjot, B. Chevrier et al., Using multi-agent system to model prey capture in social spiders, ESS01 13th European Simulation Symposium, p.831833, 2001.

J. Ferber, Les systèmes multi-agents. Vers une intelligence collective. InterEditions, 1995. [Fer97] J. Ferber. Les systèmes multi-agents : un apercu general, p.9791012, 1997.

T. Finin, R. Fritzson, D. Mckay, R. Mcentirefj91, ]. J. Ferber et al., The framework of eco-problem solving Decentralized A.I. 2 : Proc. of the 2nd European Workshop on Modelling Autonomous Agents in a Multi-Agent World Inuences and reaction : A model of situated multiagent systems [Foi98] R. Foisel. Modèle de réorganisation de systèmes multi-agents : une approche descriptive et opérationnelle Decentralized language learning through acting, KQML as an Agent Communication Language Proceedings of the 3rd International Conference on Information and Knowledge Management (CIKM'94) International Conference on Multi-Agent Systems Proc. 3rd Intl. Joint Conf. on Autonomous Agents and Multi Agent SystemsGF98] O. Gutknecht and J. Ferber. Un meta-modèle organisationnel pour l'analyse, la conception et l'exécution de systèmes multi-agents. actes de journées francophones sur les systèmes multi-agents 98, pp.456463-181193, 1991.

C. Guestrin, D. Koller, and R. Parr, Multiagent planning with factored MDPs, Advances in Neural Information Processing Systems, pp.1523-1530, 2001.

C. Guestrin, D. Koller, R. Parr, S. [. Venkataraman, M. Guestrin et al., Ecient solution algorithms for factored mdps Coordinated reinforcement learning, Nineteenth International Conference on Machine Learning Grasse. La reconstruction du nid et les coordinations interindividuelles chez bellicositermes natalensis et cubitermes sp., la théorie de la stigmergie : essais d'interprétation du comportement des termites constructeurs, pp.399468-227, 1959.

]. C. Bibliographie-[-gue03 and . Guestrin, Planning Under Uncertainty in Complex Structured Environments, 2003.

S. [. Goldman and . Zilberstein, Optimizing information exchange in cooperative multi-agent systems, Proceedings of the second international joint conference on Autonomous agents and multiagent systems , AAMAS '03, 2003.
DOI : 10.1145/860575.860598

S. [. Goldman and . Zilberstein, Decentralized control of cooperative systems : Categorization and complexity analysis, J. Artif. Intell. Res. (JAIR), vol.22, p.143174, 2004.

]. G. Har68 and . Hardin, the tragedy of the commons, Science, p.12431248, 1968.

J. [. Horvitz, M. Breese, and . Henrion, Decision theory in expert systems and articial intelligence, Journal of Approximate Reasoning,Special Issue on Uncertainty in Articial Intelligence, p.247302, 1988.

D. [. Hansen, S. Bernstein, and . Zilberstein, Dynamic programming for partially observable stochastic games, AAAI, p.709715, 2004.

]. C. Hem96 and . Hemelrijk, Dominance interactions, spatial dynamics and emergent reciprocity in a virtual world. fourth international conference on simulation of adaptive behavior, p.545552, 1996.

]. C. Hem99 and . Hemelrijk, An individual-oriented model on the emergence of despotic and egalitarian societies, Proceedings of the Royal Society London B : Biological Sciences, p.361369, 1999.

]. C. Hem00 and . Hemelrijk, Towards the integration of social dominance and spatial structure, Animal Behaviour, p.10351048, 2000.

R. C. Jost, J. Jeanson, C. Denebourg, G. Rivault, and . Theraulaz, Self-organized aggregation in cockroaches : sensitivity to model structure, International Workshop on Self-Organization and Evolution of Social Behaviour, 2002.

]. N. Joh02 and . Johnson, the development of collective structure and its response to environmental change. International workshop on self-organization and evolution of social behaviour, p.215237, 2002.

]. J. Joz01 and . Jozefowiez, conditionnement opérant et problèmes décisionnels de markov, partie : Reinforcement learning and conditionning : an overview, 2001.

K. [. Jennings, M. Sycara, and . Wooldridge, A roadmap of agent research and development, Journal of Autonomous Agents and Multi-Agent Systems, vol.1, issue.1, p.738, 1998.

]. O. Jud94 and . Judson, The rise of the individual-based model in ecology, Trends in Ecology and Evolution, vol.9, p.372377, 1994.

J. R. Krebs and N. B. Davies, An introduction to behavioral ecology Oxford : Blackwell Science, 1993.

[. Keil and D. Goldin, Modeling indirect interaction in open computational systems . 1st Int'l workshop on Theory and Practice of Open Computational systems, 2003.

B. [. Lumer and . Faieta, Diversity and adaptation in populations of clustering ants. From Animals to Animats 3, p.501508, 1994.

]. M. Lit94a and . Littman, Markov games as a framework for multi-agent reinforcement learning, Proceedings of the 11th International Conference on Machine Learning (ML-94), p.157163, 1994.

]. M. Lit94b and . Littman, Memoryless policies : Theoretical limitations and practical results, Simulation of Adaptive Behaviour (SAB-94), p.238245, 1994.

]. M. Lit94c and . Littman, The witness algorithm : Solving partially observable markov decision processes, 1994.

C. [. De-loor, P. Septseault, and . Chevaillier, Les émotions : une métaphore pour la résolution de problèmes dynamiques distribués. Déploiement des systèmes multiagents , vers un passage à l'échelle, JFSMA'2003 Revue des sciences et technologies de l'information, p.331344, 2003.

[. Maia, Rapport d'avant projet maia, 2002.

. Mhk-+-98-]-n, M. Meuleau, K. Hauskrecht, L. Kim, L. Peshkin et al., Solving very large weakly coupled markov decision processes, AAAI/IAAI, p.165172, 1998.

M. [. Mathieu and . Verrons, Ants : an api for creating negotiation applications, Proceedings of the 10th ISPE International Conference on Concurrent Engineering : Research and Applications (CE2003), 2003.
URL : https://hal.archives-ouvertes.fr/hal-00731974

]. H. Par97 and . Van-parunak, Go to the ant : Engineering principles from natural agent systems, Annals of Operations Research, p.69101, 1997.

]. R. Par98 and . Parr, Flexible decomposition algorithms for weakly coupled Markov decision problems, Fourteenth Annual Conference on Uncertainty in Articial Intelligence (UAI-98), p.422430, 1998.

]. S. Pic01 and . Picault, Modèles de comportements sociaux pour les collectivités de robots et d'agents, 2001.

M. [. Pynadath and . Tambe, The communicative multi-agent team decision problem : analyzing teamwork : theories and models, Journal of Articial Intelligence Research, vol.16, p.389423, 2002.

]. M. Put94 and . Puterman, Markov Decision Processes : Discrete Stochastic Dynamic Programming, 1994.

J. [. Papendick, W. Wellner, and . Dilger, Society rst and then minds : Self organisation of a social symbol system by learning agents. International Workshop on Self organisation and evolution of social behaviour, p.323333, 2002.

Y. [. Ribeiro and . Demazeau, A dynamic interaction model for multi-agent systems, Proceedings of the 2d Iberoamerican Workshop on Distributed Articial Intelligence and Multi-Agent Systems, p.2736, 1998.

]. C. Rey87 and . Reynolds, Flocks, herds, and schools : A distributed behavioral model, 1987.

M. [. Rao and . George, BDI-agents : from theory to practice, Proceedings of the First Intl. Conference on Multiagent Systems, 1995.

[. Russel and P. Norvig, Articial Intelligence : a modern approach, 1995.

. [. Bibliographie, A. Rescorla, and . Wagner, A theory of pavlovian conditioning : Variations in the eectiveness of reinforcement and nonreinforcement. Classical conditioning II : Current research and theory, p.6499, 1972.

A. [. Sutton and . Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

F. [. Szer, S. Charpillet, and . Zilberstein, Maa*, a heuristic search algorithm for solving decentralized decpomdps, 2005.

T. [. Shoham, R. Grenager, and . Powers, Multi-agent reinforcement learning : A critical survey, 2003.

]. C. Sha01 and . Shalizi, Causal Architecture, Complexity and Self-Organization in Time Series and Cellular Automata, 2001.

]. O. Sig03 and . Sigaud, Comportements adaptatifs pour les agents dans des environnements informatiques complexes, 2003.

]. O. Sig04 and . Sigaud, Comportements adaptatifs pour des agents dans des environnements informatiques complexes. Habilitation à Diriger des Recherches de l'Université PARIS 6, 2004.

]. O. Sim01 and . Simonin, Le modèle staisfaction-altruisme, 2001.

]. R. Smi88 and . Smith, The contract net protocol : High-level communication and control in a distributed problem solver, Readings in Distributed Articial Intelligence, p.357366, 1988.

H. Schroeder, A. M. Toniolo, A. Nehlig, and D. Desor, Long-term eects of early diazepam exposure on social dierentiation in adult male rats subjected to the divingfor-food situation, Behavioural Neurosciences, vol.112, p.12091217, 1998.

J. Schneider, W. Wong, A. Moore, and M. Riedmiller, Distributed value functions, Proceedings of the 16th International Conference on Machine Learning, p.371378, 1999.

]. V. Tbc04a, C. Thomas, V. Bourjot, and . Chevrier, Interac-dec-mdp : Towards the use of interactions in dec-mdp, Third International Joint Conference on Autonomous Agents and Multi-Agent Systems -AAMAS'04, p.14501451, 2004.

]. V. Tbc04b, C. Thomas, V. Bourjot, and . Chevrier, Un formalisme pour la construction automatique dínteractions dans les sma réactifs, Journées Francophones sur les Systèmes Multi-Agents -JFSMA 2004, 2004.

C. [. Thomas, V. Bourjot, and . Chevrier, Heuristique pour l'apprentissage automatique décentralisé d'interactions dans un système multi-agents réactif, p.6, 2006.

C. [. Thomas, V. Bourjot, D. Chevrier, and . Desor, Mas and rats : Multi-agent simulation of social dierentiation in rats groups, International Workshop on Self- Organization and Evolution of Social Behaviour, 2002.

C. [. Thomas, V. Bourjot, D. Chevrier, and . Desor, Hamelin : A model for collective adaptation based on internal stimuli, From animal to animats 8 -Eighth International Conference on the Simulation of Adaptive Behaviour 2004 -SAB'04, p.425434, 2004.
URL : https://hal.archives-ouvertes.fr/inria-00108103

C. [. Thomas, V. Bourjot, and . Chevrier, Un formalisme pour la construction automatique dínteractions dans les smas réactifs(version longue), 2005.

]. S. Thr92 and . Thrun, Ecient exploration in reinforcement learning, 1992.

D. [. Tumer and . Wolpert, Collective intelligence and braess' paradox, Proceedings of the Seventeenth National Conference on Articial Intelligence and Twelfth Conference on Innovative Applications of Articial Intelligence, p.104109, 2000.

P. [. Watkins and . Dayan, Technical note q-learning, Machine Learning, vol.8, p.279292, 1992.

]. S. Wil91, N. R. Wilson, and . Jennings, The animat path to ai. From Animals to Animats Intelligent agents : Theory and practice, Knowledge Engineering Review, vol.10, issue.2, p.1521115152, 1991.

S. [. Wang and . Mahadevan, Hierarchical optimization of policy-coupled semimarkov decision processes, ICML '99 : Proceedings of the Sixteenth International Conference on Machine Learning, p.464473, 1999.