Hiding admin bar should not prevent access to the wp-admin. I suppose that you have some plugin which has option like ‘prevent access to wp-admin’ in its settings. Try to deactivate all plugins. Will user with such custom role get access to wp-admin? If ‘Yes’, then activate plugins back one by one with new test in order to isolate one which causes a problem.