Inspired by the theory of cognitive science, we explicitly model an agent equipped with both semantic and episodic memory systems, demonstrating that this approach outperforms the use of just one of these memory systems. To substantiate this claim, we have designed and released a challenging environment called "the Room," which is compatible with OpenAI Gym. In this environment, an agent must effectively learn how to encode, store, and retrieve memories in order to maximize its rewards. The Room environment facilitates a hybrid intelligence setup, enabling collaboration between machines and humans. Our results show that two agents working together achieve better performance compared to a single agent acting alone.