I think there's a bit of a difference between thinking that individual athletes shouldn't be banned because of politics and thinking that a country & its athletes should be banned because said country's government chose to violate the spirit of the Olympic truce and invade another country just days after the Olympics ended and days before the Paralympics started.
Should we ban any athlete who expresses a political opinion we don't agree with? Nope. Should we ban any country from participating in international competition as long as its government has committed what is widely regarded as an illegal invasion of another country? Absolutely.
The IOC (well, really Bach) lost the plot in trying to tread some middle ground path in allowing "Individual Neutral Athletes" from Russia and Belarus to participate in the Olympics as long as they either disavowed the invasion of Ukraine or at least kept their mouths shut for the past two years if they do support their government. In allowing that middle ground path to exist, it opens up the question of whether or not an individual athlete should be punished for expressing any political opinion. Are we going to ban athletes who loudly oppose transgender athletes participating in women's sports? Are we going to ban athletes who believe in jailing anyone who uses any drugs (even recreationally smoking marijuana)? Are we going to ban athletes who support various politicians or lawfully elected governments (eg - Xi, Milei, etc)? The reason for the Russian and Belarusian ban is because of what Putin and Lukashenko have done to Ukraine and there simply should not have been any middle ground path offered by the IOC because that only muddies up the waters and allows the philosophical discussion to shift from horror and a resolute unacceptance of the illegal invasion of another country to the political views of individual athletes.
In that regard, I can understand where Adam is coming at this from and I don't, fundamentally, disagree with him. The problem is that this was not the reason for the ban and he does seem, like the IOC, to have allowed himself to forget that critical plot point.