"Optimal play" means both players make the best possible move at every turn. No mistakes. No random choices. Each player assumes the opponent will also play perfectly.
This changes everything. In real games, you might hope your opponent blunders. In Game Theory DP, you assume they won't. Your strategy must work against a perfect opponent. If a problem says "both players play optimally," that's your signal: this is Game Theory DP.