The insight: minimum removals equals total intervals minus maximum you can keep. If you have intervals and can keep at most non-overlapping, you must remove .
This transforms the problem into activity selection. Find the maximum non-overlapping set, then subtract from total. You already know how to maximize: sort by end time and greedily select. Without this transformation, you would try removing intervals in many different orders.