In the end, Woolwich has little say over what happens in the downtown core