Develop a brain electrical stimulation paradigm to control brain processes and behavior (Sep 2021 – Present)

The skills and knowledge we acquire reside within our brains. If we have an understanding of the brain activity patterns associated with valuable skills, knowledge, or behaviors, could we potentially encode this information into one’s brain through external stimulation? This project explores the potential of utilizing brain electrical stimulation to influence brain activity, cognitive processes, and behavior. This study contributes to advancing the understanding of brain stimulation techniques to control neural population activity, paving the way for future developments in neuromodulation technology.

Develop a framework to express experiences of reinforcement learning agents in data-driven manner (Jan 2023 – Present)

We accumulate knowledge through our experiences. However, these experiences are often tacit and not easily expressable in words. Consequently, when attempting to grasp implicit knowledge or skills acquired through experiences, it is challenging to discern the specific experiences that led to the development of such skills or knowledge.

In this study, I use reinforcement learning agents to construct a framework that translates one’s experiences into a data-driven format. The agents’ experiences can be conveniently recorded as data, allowing for comprehensive analysis of the experience. Through this analysis, we can decipher the experiences that contribute to the acquisition of particular skills or knowledge. By applying this framework to an agent functioning in a human-like environment, we may uncover insights into the experiences needed to gain specific implicit knowledge.

Reveal a monkey’s ability for prospective thinking in solving a maze game (Sep 2019 – May 2021)

The decision-making process is closely interrelated with the process of learning. Monkeys are frequently employed as subjects in scientific research about learning and decision making due to their capability to engage in comparatively intricate tasks compared to other animal subjects. In this study, we evaluate their ability to make prospective decisions through forward-thinking.