Yes, this is done by using the “Call Schedule” feature and can be applied to the WAN interface of the router as well as to the Wireless LAN (dependant on the features supported by your router). This can also be implemented by configuring the firewall to block traffic for certain users at a particular time of the day or outside working hours.

Please check out this link or this one for examples of configuring this feature.