A long-term goal of artificial intelligence research is to develop artificial assistants (AI agents) that can collaborate with and empower their users. This goal raises important questions, such as how AI agents may understand a person's goals, plans and beliefs in order to facilitate effective collaboration. In this talk I give an overview of the Malmo Collaborative AI Challenge – a challenge our team recently conducted to increase awareness of these research challenges and enable steps towards solutions. I will give an overview of the challenge task and initial findings. Finally, the winning teams of the challenge will present their approach and insights gained towards developing collaborative AI.