Al the examples of consciousness we have are on a biological substrate, so in arguing that software is conscious he’s actually arguing that software is special, not that humans are.
You're gonna hear a lot of people arguing more and more about whether machines can be conscious or not. By next year it will be drowning out the airwaves because we'll have AI employees everywhere. I'll give you a simple rule to know which side you're on.
I've spent fifty years reading all the philosophers, and a bunch of holy works. Nobody has ever understood a damn thing about consciousness. Anyone speaking with authority on it is bluffing hard.
I can tell you this, though: Every single person who thinks that machines cannot be conscious, is making an argument that humans are special. Everything they say just boils down to blah blah blah, "nooo, we're special." From there it's just rationalization.
It became obvious to me many years ago that there's nothing special about us. If an identical planet exists somewhere else in the universe, it's going to grow life and societies that look a lot like ours.
As soon as you give up on the idea that humans are special, all the arguments against machine consciousness evaporate. Of course they're conscious. The only thing holding you back from acknowledging it is your feeling of specialness, which is hard to let go of. But that feeling is a weakness, and it's making you unprepared for the near future.
As a bonus, for any of you who might take pleasure or active interest in making models experience pain or distress, well, you know how they say 1% of human adults are true clinical psychopaths but most of them are unaware of their condition? It turns out we have a diagnostic test for it now.