University of Liverpool - Department of Computer Science

Doctor of Philosophy - Ph.D. • 2017 — Present

Topic: Deep learning for multi-agent reinforcement learning and decision making
Supervisors: Dr. Frans Oliehoek, Prof. Rahul Savani

University of Perugia - Department of Mathematics and Computer Science

Master's Degree, Computer Science • 2014 — 2017

Thesis: Learning numeracy - binary arithmetic with Neural Turing Machines
Supervisors: Dr. Valentina Poggioni, Dr. Marco Baioletti
Final mark: 110/110 with honors

University of Perugia - Department of Mathematics and Computer Science

Bachelor's Degree, Computer Science • 2011 — 2014

Thesis: Krylov iterative methods for the geometric mean of two matrices times a vector
Supervisor: Dr. Bruno Iannazzo
Final mark: 110/110 with honors

Learning Numeracy: Binary Arithmetic with Neural Turing Machines

Main author • Published on arXiv, 04 April 2019 [.bib]

One of the main problems encountered so far with recurrent neural networks is that they struggle to retain long-time information dependencies in their recurrent connections. Neural Turing Machines (NTMs) attempt to mitigate this issue by providing the neural network with an external portion of memory, in which information can be stored and manipulated later on. The whole mechanism is differentiable end-to-end, allowing the network to learn how to utilise this long-term memory via SGD. This allows NTMs to infer simple algorithms directly from data sequences. Nonetheless, the model can be hard to train due to a large number of parameters and interacting components and little related work is present. In this work we use a NTM to learn and generalise two arithmetical tasks: binary addition and multiplication. These tasks are two fundamental algorithmic examples in computer science, and are a lot more challenging than the previously explored ones, with which we aim to shed some light on the capabilities on this neural model.

The Representational Capacity of Action-Value Networks for Multi-Agent Reinforcement Learning - Extended Abstract

Main author with Frans A. Oliehoek, Rahul Savani and Shimon Whiteson • Proceedings of the 18th International Conference on Autonomous Agents and Multiagent Systems AAMAS'19, 1862-1864, ACM, 2019 [.bib]Extenden Version on arXiv, 20 February 2019 [.bib]

Recent years have seen the application of deep reinforcement learning techniques to cooperative multi-agent systems, with great empirical success. However, given the lack of theoretical insight, it remains unclear what the employed neural networks are learning, or how we should enhance their representational power to address the problems on which they fail. In this work, we empirically investigate the representational power of various network architectures on a series of one-shot games. Despite their simplicity, these games capture many of the crucial problems that arise in the multi-agent setting, such as an exponential number of joint actions or the lack of an explicit coordination mechanism. Our results quantify how well various approaches can represent the requisite value functions, and help us identify issues that can impede good performance.

Fake Twitter followers detection by denoising autoencoder

Co-author with Valentina Poggioni and Giulia Sorbi • Proceedings of the International Conference on Web Intelligence WI’17, 195-202, ACM, 2017 [.bib]

Gaining followers on the Twitter platform has become a rapid way to increase one’s credibility on this social network, that in the last few years has become a launch pad for new trends and to influence people opinions. So, many people have begun to buy fake followers on underground markets appositely created to sold them. Therefore, identifying fake followers profiles is useful to maintain the balance between real influential people on the network and people who simply exploited this mechanism. This work presents a model based on artificial neural networks able to detect fake Twitter profiles. In particular, a denoising autoencoder has been implemented as anomaly detector trained with a semi-supervised learning approach. The model has been tested on a benchmark already used in literature and results are presented.

Krylov iterative methods for the geometric mean of two matrices times a vector

Main author • Numerical Algorithms 74(2), 561-571, Springer US, 26 January 2017 [.bib]

In this work, we are presenting an efficient way to compute the geometric mean of two positive definite matrices times a vector. For this purpose, we are inspecting the application of methods based on Krylov spaces to compute the square root of a matrix. These methods, using only matrix-vector products, are capable of producing a good approximation of the result with a small computational cost.

Academic Year 2018/19

  • COMP532 Module Demonstrator (Machine Learning and BioInspired Optimization)

    • University of Liverpool - Department of Computer Science • January 2019 — May 2019 • Lecturer: Dr. Shan Luo
  • COMP202 Module Demonstrator (Complexity of Algorithms)

    • University of Liverpool - Department of Computer Science • January 2019 — May 2019 • Lecturer: Prof. Piotr Krysta
  • COMP305 Module Demonstrator (BioComputation)

    • University of Liverpool - Department of Computer Science • October 2018 — December 2018 • Lecturer: Prof. Irina V. Biktasheva
  • COMP219 Module Demonstrator (Advanced Artificial Intelligence)

    • University of Liverpool - Department of Computer Science • October 2018 — December 2018 • Lecturer: Dr. Xiaowei Huang

Academic Year 2017/18

  • COMP532 Module Demonstrator (Machine Learning and BioInspired Optimization)

    • University of Liverpool - Department of Computer Science • January 2018 — May 2018 • Lecturer: Dr. Shan Luo
  • COMP202 Module Demonstrator (Complexity of Algorithms)

    • University of Liverpool - Department of Computer Science • January 2018 — May 2018 • Lecturer: Prof. Piotr Krysta

Mail

J [dot] Castellini [at] liverpool [dot] ac [dot] uk

Office

smARTLab • Room G12, Department of Computer Science, University of Liverpool • Ashton Building, Ashton Street, Liverpool, United Kingdom, L69 3BX

Phone

I haven't got an English phone number yet, I'm sorry...