Publications


Home

CV                                                                                                 

Publications

Ph.D Students

Books:

  1. K. Tuyls, Z. Guessoum, A. Nowe, D. Kudenko (eds.) (2008). “Adaptive Agents and Multi-Agent Systems III”, Springer LNAI 4865.

  2. D. Kudenko, D. Kazakov, E. Alonso (eds.) (2005). “Adaptive Agents and Multi-Agent Systems II”, Springer LNAI 3394.

  3. E. Alonso, D. Kazakov, D. Kudenko (eds.) (2003). “Adaptive Agents and Multi-Agent Systems”, Springer LNAI 2636.

 

Book Chapters :

  1. E. Ridge, D. Kudenko (2008). Determining whether a problem characteristic affects heuristic performance. A rigorous Design of Experiments approach", In: C. Cotta, J. van Hemert (eds.): Recent Advances in Evolutionary Computation for Combinatorial Optimization. Springer, Studies in Computational Intelligence Vol. 153.

  2. H. Barber, D. Kudenko (2007). “Adaptive Generation of Dilemma-Based Interactive Narrative”, In: N. Baba, L. C. Jain, H. Handa (eds.): Advanced Intelligent Paradigms in Computer Games, Springer.

  3. D. Kudenko, D. Kazakov, E. Alonso (2002). “Machine Learning for Agents and Multi-Agent Systems”, In: V. Plekhanova (ed.): Intelligent Agent Software Engineering, Idea Group Publishing.

  4. D. Kazakov, D. Kudenko (2001). “Machine Learning and Inductive Logic Programming for Multi-Agent Systems”, In: M.Luck, V. Marik, O. Stepankova, and R. Trappl (eds.): Multi-Agent Systems and Applications, Springer LNAI 2086.

 

Refereed Papers:

  1. S. Devlin, M. Grzes, D. Kudenko (2011): An Empirical Study of Potential-Based Reward Shaping and Advice in Complex, Multi-Agent Systems”, Advances in Complex Systems 14(2).

  2. R. Hodhod, D. Kudenko, P. Cairns (2011):  “Innovative Integrated Architecture for Educational Games: Challenges and Merits”, Transactions on Edutainment 5.

  3. S. Devlin, D. Kudenko (2011): “Theoretical Considerations of Reward Shaping for Multi-Agent Systems”, Tenth International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS).

  4. S. Devlin, M. Grzes, D. Kudenko (2011): “Multi-Agent Potential-based Reward Shaping for RoboCup KeepAway”, Tenth International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS).

  5. M. Grzes, D. Kudenko (2010): "PAC-MDP Learning with Knowledge-based Admissible Models",  Ninth International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS).

  6. H. Barber, D. Kudenko (2010): "Generation of Adaptive Dilemma-based Interactive Narratives", IEEE Transactions on Computational Intelligence in Games 1(4).

  7.  R. Hodhod, D. Kudenko, P. Cairns (2010):  “Innovative Integrated Architecture for Educational Games: Challenges and Merits”, Transactions on Edutainment [to appear].

  8. M. Grzes, D. Kudenko (2010): "Online Learning of Shaping Rewards in Reinforcement Learning", Neural Networks 23(4).

  9.  M. Zheng, D. Kudenko (2010): “Automated Event Recognition for Football Commentary Generation”, International Journal of Gaming and Computer-Mediated Simulations 2(4).

  10.  R. Hodhod, D. Kudenko, P. Cairns (2010):  “Adaptive Interactive Narrative Model to teach Ethics”, International Journal of Gaming and Computer-Mediated Simulations 2(4).

  11. M. Arinbjarnar, D. Kudenko (2010): “Bayesian Networks: Real-Time Applicable Decision Mechanisms for Intelligent Agents”, IEEE Conference on Computational Intelligence and Games (CIG’10).

  12. S. Devlin, M. Grzes, D. Kudenko (2010): “Multi-Agent Reinforcement Learning with Reward Shaping for KeepAway Takers”, AAMAS'10 Workshop on Adaptive and Learning Agents (ALA'10).

  13. R. Hodhod, D. Kudenko, P. Cairns (2010): "Character Education using Pedagogical Agents and Socratic Voice", The 23rd International FLAIRS Conference.

  14. M. Arinbjarnar, D. Kudenko (2009): “Actors and Characters in Virtual Drama”, Ninth International Conference on Intelligent Virtual Agents (IVA).

  15. R. Hodhod, D. Kudenko, P. Cairns (2009): “Educational Narrative and Student Modeling for Ill-Defined Domains.”, International Conference on Artificial Intelligence for Education (AIED).

  16. S. Devlin, M. Grzes, D. Kudenko (2009): “Reinforcement Learning in RoboCup KeepAway with Partial Observability”, IEEE/WIC/ACM International Joint Conference on Intelligent Agent Technology (IAT).

  17. M . Arinbjarnar, D. Kudenko (2009): “Directed Emergent Drama vs. Pen & Paper Role-Playing Games.”, AISB'09 Symposium: AI & Games.

  18. M. Arinbjarnar, H. Barber, D. Kudenko (2009): “A Critical Review of Interactive Drama Systems”, AISB'09 Symposium: AI & Games.

  19. M.Zheng, D. Kudenko (2009): “Automated Event Recognition for Football Commentary Generation”, AISB'09 Symposium: AI & Games.

  20. R. Hodhod, D. Kudenko, P. Cairns (2009): “Serious Games to Teach Ethics”. AISB'09 Symposium: AI & Games.

  21. R. Hodhod, D. Kudenko, P. Cairns. (2009). “AEINS: Adaptive Educational Interactive Narrative System to Teach Ethics”. AIED Workshop on Intelligent Educational Games.

  22. M. Grzes and D. Kudenko (2009). “Reinforcement Learning with Reward Shaping and Mixed Resolution Function Approximation”. International Journal of Agent Technologies and Systems (IJATS), 1(2):36-54.

  23. M. Grzes and D. Kudenko (2009): “Improving Optimistic Exploration in Model-free Reinforcement Learning”, Proceedings of the 9th International Conference on Adaptive and Natural Computing Algorithms  (ICANNGA'09).

  24. M. Grzes and D. Kudenko (2009): “Learning Shaping Rewards in Model-based Reinforcement Learning”, AAMAS'09 Workshop on Adaptive and Learning Agents (ALA'09).

  25.  M. Arinbjarnar, D. Kudenko (2008): "Schemas in Directed Emergent Drama", First Joint International Conference on Interactive Digital Storytelling (ICIDS), Springer LNCS 5334.

  26. H. Barber, D. Kudenko (2008): "Generation of Dilemma-based Narratives: Method and Turing Test Evaluation", First Joint International Conference on Interactive Digital Storytelling (ICIDS), Springer LNCS 5334.

  27. R. Hodhod, D. Kudenko (2008): "Towards Intelligent Educational Interactive Narrative". International Conference on Narrative in Interactive Learning Environments (NILE).

  28. R. Hodhod, D. Kudenko (2008): "Interactive Narrative and Intelligent Tutoring for Ill Defined Domains". Workshop on Intelligent Tutoring Systems for Ill-Structured Domains at ITS'08.

  29. A. Servin, D. Kudenko (2008): "Multi-Agent Reinforcement Learning for Intrusion Detection: A case study and evaluation", Sixth German Conference on Multi-Agent System Technologies (MATES).

  30. M. Grzes, D. Kudenko (2008): "Plan-based reward shaping for reinforcement learning", Fourth IEEE International Conference on Intelligent Systems (IS), IEEE.

  31. M. Grzes, D. Kudenko (2008): "Robustness Analysis of SARSA(lambda): Different Models of Reward and Initialisation", 13th International Conference on Artificial Intelligence: Methodology, Systems, Applications (AIMSA), Springer LNAI 5253.

  32. M. Grzes, D. Kudenko (2008): "Multigrid reinforcement learning with reward shaping", 18th International Conference on Artificial Neural Networks (ICANN), Springer LNCS 5163.

  33. M. Grzes, D. Kudenko (2008): “An Empirical Analysis of the Impact of Prioritised Sweeping on DynaQ”, International Conference on Artificial Intelligence and Soft Computing (ICAISC).

  34. M. Grzes, D. Kudenko (2008): “Learning Potential for Reward Shaping in Reinforcement Learning with Tile Coding”, Eighth Workshop on Adaptive Agents and Multi-Agent Systems (ALAMAS-ALAg).

  35. M. Grzes, D. Kudenko (2008): “Plan-based Reward Shaping for Reinforcement Learning”, Eighth Workshop on Adaptive Agents and Multi-Agent Systems (ALAMAS-ALAg).

  36.  A. Servin, D. Kudenko (2008): “Multi-Agent Reinforcement Learning for Intrusion Detection: A case study and evaluation”, Eighth Workshop on Adaptive Agents and Multi-Agent Systems (ALAMAS-ALAg).

  37. H. Barber, D. Kudenko (2008): “Generation of Dilemma-based Interactive Narratives with a Changeable Story Goal”, Second International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

  38. E. Ridge, D. Kudenko (2007): “Tuning the Performance of the MMAS Heuristic”, Workshop on Engineering Stochastic Local Search Algorithms (SLS), Springer LNCS 4638 [Best Paper Award].

  39. E. Ridge, D. Kudenko (2007): “Analyzing Heuristic Performance with Response Surface Models: Prediction, Optimization and Robustness”, Genetic and Evolutionary Computation Conference (GECCO) [Best Paper Nomination]

  40. E. Ridge, D. Kudenko (2007): “Screening and Tuning the Parameters Affecting Heuristic Performance”, Genetic and Evolutionary Computation Conference (GECCO).

  41. H. Barber, D. Kudenko (2007). “Dynamic Generation of Dilemma-based Interactive Narratives”, Artificial Intelligence and Interactive Entertainment (AIIDE).

  42. E. Ridge, D. Kudenko (2007). “An Analysis of Problem Difficulty for a Class of Optimisation Heuristics”, Seventh European Conference on Evolutionary Computation in Combinatorial Optimization (EvoCOP).

  43. M. Grounds, D. Kudenko (2007). “Parallel Reinforcement Learning with Linear Function Approximation”, International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS).

  44. H.Barber, D. Kudenko (2007). “A User Model for the Dynamic Generation of Dilemma-based Interactive Narratives”, AIIDE Workshop on Optimizing Player Satisfaction.

  45. A. Servin, D. Kudenko (2007). “Multi-Agent Reinforcement Learning for Intrusion Detection”, Seventh Symposium on Adaptive and Learning Agents and Multi-Agent Systems (ALAMAS), also in Springer LNAI 4865.

  46. H. Barber, D. Kudenko (2007). “Interactive Generation of Dilemma-based Narratives”, Symposium on AI  and Narrative Games for Education.

  47. Lillian Clark, I-Hsien Ting, Chris Kimble, Peter Wright, Daniel Kudenko (2006). "Combining Ethnographic and Clickstream Data to Identify Browsing Strategies" Journal of Information Research 11 (2).

  48. Z. Lock, D. Kudenko (2006). “Interactions between Stereotypes”, Adaptive Hypermedia and Adaptive Web-Based Systems (AH ’06).

  49. E. Ridge, D. Kudenko and D. Kazakov (2006). “A Study of Concurrency in the Ant Colony System Algorithm”. Annual IEEE Congress on Evolutionary Computation  (CEC 2006).

  50. M. Grounds, D. Kudenko (2006). “Parallel Reinforcement Learning by Merging Function Approximations”, Sixth European Workshop on Adaptive and Learning Agents and Multi-Agent Systems (ALAMAS’06), also in Springer LNAI 4865.

  51. E. Ridge, D. Kudenko and D. Kazakov (2006). “Parallel, Asynchronous and Decentralised Ant Colony System”, The First International Symposium on Nature-Inspired Systems for Parallel, Asynchronous and Decentralised Environments (NISPADE).

  52. I-Hsien Ting, C. Kimble, D. Kudenko (2005). "UBB Mining: Finding Unexpected Browsing Behaviour in Clickstream Data to Improve a Web Site's Design", IEEE/WIC/ACM International Conference on Web Intelligence (WI 2005).

  53. I-Hsien Ting, C. Kimble, D. Kudenko (2005) "A Pattern Restore Method for Restoring Missing Patterns in Server Side Clickstream Data", Web Technologies Research and Development (APWeb 2005), Springer LNCS 3399.

  54.  Z. Lock, D. Kudenko (2005). “Combining Stereotypes for Robust Information Prioritization”, UM’05 Workshop on Decentralized Agent-Based and Social Approaches to User Modeling (DASUM).

  55.  M. Grounds, D. Kudenko (2005). ”Combining Reinforcement Learning with Symbolic Planning”, FifthEuropean Workshop on Adaptive Agents and Multi-Agent Systems, also in Springer LNAI 4865.

  56. X.S. Lu and D. Kudenko (2005). “Reinforcement Learning in a Sensor-Evader Domain”, Fifth European Workshop on Adaptive Agents and Multi-Agent Systems.

  57. S. Kapetanakis, D. Kudenko, M. Strens (2004). “Learning of Coordination in Cooperative Multi-Agent Systems using Commitment Sequences”, Artificial Intelligence and the Simulation of Behavior 1(5).

  58. T. Walker, D. Kudenko, M. Strens (2004). “Algorithms for Distributed Exploration”, Proceedings of the Sixteenth European Conference on Artificial Intelligence (ECAI ’04).

  59. S. Kapetanakis, D. Kudenko (2004). "Reinforcement Learning of Coordination in Heterogeneous Cooperative Multi-Agent Systems", Proceedings of the Third International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS’04).

  60. I-Hsien Ting, C. Kimble, D. Kudenko (2004). "Visualizing and Classifying the Pattern of User's Browsing Behaviour for Website Design Recommendation", First International Workshop on Knowledge Discovery in Data Streams.

  61. M. Carpenter, D. Kudenko (2004). "Baselines for Joint-Action Reinforcement Learning of Coordination in Cooperative Multi-Agent Systems", Fourth Symposium on Adaptive Agents and Multi-Agent Systems, also in Springer LNAI 3394.

  62. S. Kapetanakis, D. Kudenko (2004). "Reinforcement Learning of Coordination in Heterogeneous Cooperative Multi-Agent Systems", Fourth Symposium on Adaptive Agents and Multi-Agent Systems, also in Springer LNAI 3394.

  63. I-Hsien Ting, Chris Kimble, Daniel Kudenko (2004). “Visualizing and Classifying the Pattern of user's Browsing Behavior for Website Design Recommendation”, First International Workshop on Knowledge Discovery in Data Streams.

  64. D. Kudenko, M. Bauer, D. Dengler (2003). “Group Decision Making Through Mediated Discussions”, Proceedings of the Ninth International Conference on User Modeling (UM ’03), Springer LNAI 2702.

  65. S. Baldes, M. Bauer, D. Dengler, A. Jameson, D. Kudenko, G. Paul, T. Rist, C. Schmitt (2003). “MIAU – Supporting Group Decisions in E-Commerce Applications”, Proceedings of the Tenth International Conference on Human-Computer Interaction (HCII ’03).

  66. Z. Lock, D. Kudenko (2003). “Multi-Component User Models of Team Members”, UM’03 Workshop on User and Group Models for Web-based Adaptive Collaborative Environments.

  67. S. Kapetanakis, D. Kudenko, M. Strens (2003). “Learning to Coordinate Using Commitment Sequences in Cooperative Multi-Agent Systems”, Third AISB Symposium on Adaptive Agents and Multi-Agent Systems, also in Springer LNAI 2636.

  68. S. Kapetanakis, D. Kudenko (2002). Reinforcement Learning of Coordination in Cooperative Multi-Agent Systems”, Proceedings of the Nineteenth National Conference on Artificial Intelligence (AAAI).

  69. E. Alonso, M. d’Inverno, D. Kudenko, M. Luck, and J.Noble (2002). “Learning in Multi-Agent Systems”, Knowledge Engineering Review 16:3.

  70. S. Kapetanakis, D. Kudenko (2002). „Improving on Reinforcement Learning of Coordination in Cooperative Multi-Agent Systems“, Second Symposium on Adaptive Agents and Multi-Agent Systems, also in Springer LNAI 2636.  

  71. J. Vasconcelos, C. Kimble, F. Gouveia, D. Kudenko (2001). Reasoning in Corporate Memory Systems: a Case Study of Group Competencies”, Eighth International Symposium on the Management of Industrial and Corporate Knowledge (ISMICK).

  72.  D. Kudenko, M. Bauer, D. Dengler (2001). “Assisting Joint Catalogue Purchases“, UKMAS.

  73. J. Vasconcelos, C. Kimble, F. Gouveia, D. Kudenko (2000). “A Group Memory System for Corporate Knowledge Management: An Ontological Approach”, First European Conference on Knowledge Management.

  74.  E. Alonso, D.Kudenko (2000). “Logic-Based Multi-Agent Systems for Conflict Simulations”, UKMAS.

  75.  D.Kudenko (2000): “Ontology-Based Constructive Induction”, Machine Intelligence 17.

  76. E.Alonso, D.Kudenko (2000): “Machine Learning for Logic-Based Multi-Agent Systems”, Proceedings of the First Goddard Workshop on Formal Methods for Multi-Agent Systems, Springer LNAI 1871.

  77. D.Kudenko, H.Hirsh (1999): “Feature‑Based Learners for Description Logics”, Proceedings of the International Workshop on Description Logics.

  78. E.Alonso, D.Kudenko (1999): “Machine Learning Techniques for Logic‑Based Multi‑Agent Systems”, UKMAS.

  79. D.Kudenko, H.Hirsh (1998). “Feature Generation for Sequence Categorization”, Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI).

  80. W.Cohen, D.Kudenko (1997). “Transferring and Retraining Learned Information Filters”, Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI).

  81. H.Hirsh, D.Kudenko (1997). “Representing Sequences in Description Logics”, Proceedings of the Fourteenth National Conference on Artificial Intelligence (AAAI).

  82. D.Kudenko, H.Hirsh (1996): “Representing Sequences in Description Logics using Suffix Trees”, Proceedings of the International Workshop on Description Logics.

  83. J.Heinsohn, B.Nebel, D.Kudenko, H.J.Profitlich (1994). “An Empirical Analysis of Terminological Representation Systems”, Artificial Intelligence 68:2.

  84. J.Heinsohn, B.Nebel, D.Kudenko, H.J.Profitlich (1992). “An Empirical Analysis of Terminological Representation Systems”, Proceedings of the Tenth National Conference on Artificial Intelligence (AAAI).

  85. D.Kudenko (1992): “RAT: Representation of Actions using Terminological Logics”, Temporal Representation and Reasoning Workshop 92, Bolzano, Italy.

 

 Techincal Reports:

  1. E.Alonso, D.Kudenko (2000). “Logic-based Learning in Conflict Simulation Domains”, Institute for Logic, Cognition, Language and Information, University of the Basque Country, ILCLI-00-FCSAI-4.

  2. A.Borgida, D.Kudenko (1994)“Modular Implementation of Individual Reasoning in PROTODL”, Rutgers technical report LCSR‑TR‑238.

Projects

SPRC

RL Research

Games Research

AI Group