The pandemic was very clearly the initiator.

Being conservative about forcing people back (because most have wanted people back long before now) doesn’t change anything legally. You were hired for an in person job, they were forced to have you work from home by actual government orders, and they moved slowly on forcing you back because it was an extended period of time where there was an actual meaningful health risk to a big enough portion of employees.