Q-Learning Transformation for Training on JADE Agents
DOI:
https://doi.org/10.21501/21454086.1517Keywords:
Agents, Reinforced Learning, JADE, Patterns implementationAbstract
Increased interaction between computer systems has modified the traditional way to analyze and develop them. The need for interaction between the system components is increasingly important to solve joint tasks, which individually would be very expensive or even impossible to develop once. Multi-agent systems offer an interesting and complete distributed architecture to execute tasks cooperate. The creation of a multi-agent system or an agent requires great effort so methods have been adopted as the deployment patterns. The pattern creates Proactive Obsever_JADE agents and include in each endowed with intelligence behaviors can evolve using machine learning techniques. The reinforcement learning is a machine learning technique that allows agents to learn through trial and error interactions in a dynamic environment. Reinforcement learning in multi-agent systems offers new challenges arising from the distribution of learning, such as the need for coordination between agents or distribution of knowledge, which should be analyzed and treated.Downloads
References
M. Wooldridge. “An Introduction to MultiAgent Systems”. 2nd. 2009, John Wiley & Sons. ISBN: 9780470519460.
FIPA, FIPA Agent Management Specification, 2003, Foundation for Intelligent Physical Agents. URL: http://www.fipa.org/specs/fipa00023/
FIPA, FIPA Communicative Act Library Specification, 2003, FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS. URL: http://www.fipa.org/specs/fipa00037/SC00037J.html
J. Ferber. “Multi-agent systems: an introduction to distributed artificial intelligence”. 1999, Addison-Wesley. ISBN 0-201-36048-9
F. L. Bellifemine, G. Caire & D. Greenwood. “Developing Multi-Agent Systems with JADE”. 1st. 2007, Chichester: John Wiley & Sons, Ltd. ISBN: 978-0-470-05747-6. URL: http://www.wiley.com/WileyCDA/WileyTitle/productCd-0470057475.html
F. Bellifemine, F. Bergenti, G. Caire & A. Poggi, “Jade-A Java Agent Development Framework”, in Multi-Agent Programming, R. Bordini, et al. (Ed.). 2005, Springer US. pp. 125-147. URL: http://link.springer.com/chapter/10.1007%2F0-387-26350-0_5
M. Moreno, A. Carrasco, A. Rosete & M. D. Delgado. “Patrones de Implementación para Incluir Comportamientos Proactivos”. Polibits, Vol. January-June 2013, No. 47, pp. 73-87, 2013.
B. Henderson-Sellers, “From Object-Oriented to Agent-Oriented Software Engineering Methodologies”, in Software Engineering for Multi-Agent Systems III, R. Choren, et al. (Ed.). 2005, Springer Berlin Heidelberg. pp. 1-18. URL: http://link.springer.com/chapter/10.1007%2F978-3-540-31846-0_1
DARPA Envisions the Future of Machine Learning, 2013. URL: http://www.darpa.mil/news-events/2013-03-19a
T. Ishida, L. Gasser & M. Yokoo. “Organization self-design of distributed production systems”. IEEE Transactions on Knowledge and Data Engineering, Vol. 4, No. 2, pp. 123-134, 1992. DOI: 10.1109/69.134249
OMG, Agent Platform Special Interest Group: Agent Technology – Green Paper, 2000. URL: http://www.objs.com/agent/agents_Green_Paper_v100.doc
S. Franklin &A. Graesser, “Is It an agent, or just a program?: A taxonomy for autonomous agents”, in Intelligent Agents III Agent Theories, Architectures, and Languages, J. Müller, M. Wooldridge, and N. Jennings (Ed.). 1997, Springer Berlin Heidelberg. pp. 21-35. URL: http://link.springer.com/chapter/10.1007%2FBFb0013570
S. Russell &P. Norvig. “Artificial Intelligence: A Modern Approach”. 3rd, illustrated. 2010, Prentice Hall. ISBN: 978-0136042594
J. M. Crant. “Proactive Behavior in Organizations”. Journal of Management, Vol. 26, No. 3, pp. 435-462, 2000. DOI: 10.1177/014920630002600304
A. M. Grant &S. J. Ashford. “The dynamics of proactivity at work”. Research in Organizational Behavior, Vol. 28, No. -, pp. 3-34, 2008. DOI:10.1016/j.riob.2008.04.002
S. K. Parker, U. K. Bindl & K. Strauss. “Making Things Happen: A Model of Proactive Motivation”. Journal of Management, Vol. 36, No. 4, pp. 827-856, 2010. DOI: 10.1177/0149206310363732
F. Bellifemine, A. Poggi & G. Rimassa, JADE – A FIPA-compliant agent framework, 1999. URL: http://sharon.cselt.it/projects/jade/papers/PAAM.pdf
E. Gamma, R. Helm, R. Johnson & J. Vlissides. “Design Patterns: Elements of Reusable Object-oriented Software”. 2004, Pearson Education. ISBN: 978-0201634983
FIPA, FIPA Subscribe Interaction Protocol Specification, 2003, FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS. URL: http://www.fipa.org/specs/fipa00095/PC00095A.pdf
R. Barr &C. Rovee-Collier. “Encyclopedia of the Sciences of Learning”. 2012, Estados Unidos: Springer. URL: http://www.springer.com/us/book/9781441914279
P. Domingos. “A few useful things to know about machine learning”. Commun. ACM, Vol. 55, No. 10, pp. 78-87, 2012. DOI: 10.1145/2347736.2347755
A. Shhab, G. Guo & D. Neagu, A Study on Applications of Machine Learning Techniques in Data Mining, 2005. URL: http://pythia.inf.brad.ac.uk/paper/BNCODWorkshop.pdf
Leslie Pack Kaelbling, Michael L. Littman & A. W. Moore. “Reinforcement Learning: A Survey”. Artificial Intelligence Research, Vol. 4, No. pp. 237-285, 1996. DOI: 10.1.1.134.2462
R. S. Sutton &A. G. Barto. “Reinforcement Learning: An Introduction”. 1998, Cambridge, Massachusetts: The IMT Press. ISBN: 978-0262193986
INTECHOPEN. “New Advances in Machine Learning”. 2010, InTech. 374p. ISBN 978-953-307-034-6
C. Germain-Renaud, A. Cady, P. Gauron, M. Jouvin, Ch. Loomis, et al. "The Grid Observatory". IEEE Computer Society Press. IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, May 2011, Newport Beach, United States. 2011
Downloads
Additional Files
Published
How to Cite
Issue
Section
License
In accordance with national and international copyrights, as well as publishing policies of "Fundación Universitaria Luis Amigó" and its Journal "Lámpsakos" (indexed with ISSN : 2145-4086), I (we ) hereby manifest:1. The desire to participate as writers and submit to the rules established by the magazine publishers.
2. The commitment not to withdraw the manuscript until the journal finishes the editing process of the ongoing issue.
3. That article is original and unpublished and has not been nominated or submitted together in another magazine; therefore, the rights of the article in evaluation have not been assigned in advance and they do not weigh any lien or limitation for use.
4. The absence of conflict of interest with commercial institution or association of any kind
5. The incorporation of the quotes and references from other authors, tending to avoid plagiarism. Accordingly, the author affirms that the paper being published do not violate copyright, intellectual property or privacy rights of third parties. Morover, if necessary there is a way of demonstrating the respective permits original copyright to the aspects or elements taken from other documents such as texts of more than 500 words, tables, graphs, among others. In the event of any claim or action by a third party regarding copyright on the article, the author (s) will assume full responsibility and come out in defense of the rights herein assigned. Therefore, for all purposes, the Journal "Lámpsakos" of the "Fundación Universitaria Luis Amigó" acts as a third party in good faith.
6. In the event of the publication of the article, the authors free of charge and on an exclusive basis the integrity of the economic rights and the right to print, reprint and reproduction in any form and medium, without any limitation as to territory is concerned, in favor of the Journal "Lámpsakos" of the "Fundación Universitaria Luis Amigó".