EEE PhD student recognised in international publishing competition

Martin Ferianc, a second year PhD student, and Xiaoliang Luo, a PhD student from Experimental Psychology, reached the semi-finals of the prestigious Deepnote Publishing Competition.

Deepnote is an interactive platform that allows data scientists to collaborate with other engineers or researchers, and is used by some of the best universities in the world as well as other businesses for efficient data presentation and evaluation.  

Martin and Xiaoling’s experience as sessional lecturers in the Foundations of Machine Learning and Data Science module at University College London (UCL) helped them to build an accessible tutorial to a wider audience that gave interested readers a high-level overview of the fundamentals of Reinforcement Learning (RL), as well as example code implementing the presented concepts in Python.

More specifically from the domain of RL, their entry, Introduction to Reinforcement Learning, looked at an algorithm called Q-Learning, and proved popular.  

Of the results, Martin and Xiaoliang stated:

“We were very happy about the award and we hope that our tutorial will provide insights as well as an entertaining implementation of the concepts for all those who are interested in reinforcement learning.

*Photo credits: Kristina Ulicna, UCL student