I read. I write. I build stuff.
I’m interested in building machines with human-like intelligence.
My research lies in the overlapping areas of Artificial Intelligence and Robotics. I actively work on the design and development of Reinforcement Learning (RL) algorithms and continual learning systems for real-world robots. I also have a strong side interest in Neuroscience, Evolutionary Biology and Quantum Computing. All are part of an overarching goal to understand the emergence of intelligence.
I’m a PhD candidate in Statistical Machine Learning at the University of Alberta. I work under the supervision of Rupam Mahmood with the Reinforcement Learning and Artificial Intelligence (RLAI) Group.
Previously, I was a Machine Learning Researcher at Kindred Systems Inc. As a member of the AI Research Team in Toronto, I developed Deep Reinforcement Learning techniques to improve the product’s (SORT) overall throughput at e-commerce fulfillment centres like Gap Inc, etc. I was also responsible for the design, implementation and evaluation of learning algorithms and robot infrastructure as a part of the research and publication efforts at Kindred (e.g., SenseAct). I spent three wonderful years at Kindred; intially working with Geordie Rose, Suzzanne Gildert and Olivia Norton in Vancouver and subsequently with James Bergstra, Dmytro Korenkevych and Rupam Mahmood in Toronto.
I graudated with an M.Sc (Thesis) in Computing Science from the University of Alberta in 2017. I worked under the supervision of Patrick M. Pilarski with the BLINC and RLAI labs. During my masters, I mostly worked with rehabilitative and assistive robots. My thesis research was on ‟Teaching a Powered Prosthetic Arm with an Intact Arm Using Reinforcement Learning”. We used ideas from Learning from Demonstration, Actor-Critic Reinforcement Learning and explored the possibilities for synergistic, context-aware control of a prosthetic arm. This work won the 2017 M.Sc. Outstanding Thesis Award in Computing Science.
In a past life, I studied Instrumentation and Control Engineering at the National Institute of Technology (NIT), Tiruchirappalli. Under the guidance of G. Saravana Ilango, my team devised control strategies for an autonomous robotic vacuum cleaner for solar panels which garnered accolades at the Texas Instruments Innovation Challenge (2014). In addition, I evaluated methods for model predictive control, real-time trajectory generation and motion planning for quadcopters while working with K. Madhava Krishna and V. Sankaranarayanan.
My CV is available here.
Autoregressive policies for continuous control deep reinforcement learning
Benchmarking reinforcement learning algorithms on real-world robots
Context-Aware Learning from Demonstration: Using Camera Data to Support the Synergistic Control of a Multi-Joint Prosthetic Arm
Learning from demonstration: Teaching a myoelectric prosthesis with an intact limb via reinforcement learning
Spotlight presentation at Rehabweek 2017.
Confident Decision Making with General Value Functions
Mirrored Bilateral Training of a Myoelectric Prosthesis with a non-amputated arm via Actor-Critic Reinforcement Learning
Spotlight presentation (20min)
Neurohex: A Deep Q-Learning Hex Agent
Computer Games Workshop at IJCAI 2016
Autonomous Visual Tracking and Landing of a Quadrotor on a Moving Platform
IEEE ICIIP 2015
A Control Strategy for an Autonomous Robotic Vacuum Cleaner for Solar Panels
IEEE Texas Instruments India Educators Conference 2014
Phase-I Winners and finalists (top 19 among 2000+ teams)
Miscellaneous Stuff I’m Proud To Have Been A Part Of
- A short stint as a research volunteer with The Hospital for Sick Children (SickKids).
- Cerebral Palsy and Spasticity Trials. I had the pleasure of working with medical doctors on a study assessing functional gain in patients affected by stroke or spasticity using assistive robots. I built tools to analyze the recorded sensory information and setup a robot interface for 12 patients. Thanks to Patrick Pilarski, Trevor Lashyn, Matthew Curran and Ming Chan at the University of Alberta for looping me in!
- Festember, the annual International cultural festival of NIT Trichy. Festember is especially close to my heart since it was a labor of love. A lot of talented, passionate folks came together and poured tremendous effort, time and resources to create something special :) I spent two great years with the Marketing team and was the Treasurer of Festember 2014. As the Treasurer, I handled the finances of the festival (~INR 20 Million) and executed several key decisions with regards to budget, expenditure, resource management for teams, etc.
- Spider, an R&D club at NIT Trichy. We conducted tech talks and workshops focusing on microcontrollers and embedded programming.
- Pragyan, the annual technical festival of NIT Trichy. I worked with the Guest Lectures and Crossfire Teams. Personal highlights: (i) helped moderate a wonderful panel discussion on “Failing educational institutions?” (ii) Jamie Hyneman, host of Discovery Mythbusters as a guest lecturer for Pragyan 14!