Woolwich has little say over what happens in the downtown core