It is impossible with built-in WordPress capabilities as “Widgets” menu uses the same capability as the upper level menu “Appearance”.
We may block selected menu items for selected role by adding some code. Yes, I plan to add the interface for such functionality.
As about permissions for specific widgets this subject needs additional investigation. I have no ready to use decision for this moment.