Detours prove annoying to residents, a challenge to drivers