There are many options within a 10 to 20min commute to the city. Have a look at train line suburbs, you get more distance for the same amount of transport time than tram or bus. And many of the inner areas have fantastic cafes, ammenities, street vibe etc. I honestly prefer the inner suburbs vibe compared to cbd vibe. But if that’s not your thing, then having an easy commute means you will still have great access. Renting elsewhere will hopefully solve the problem of dodgy neighbours, and give breathing time to figure out your next steps. If you find you absolutely hate being out of the cbd, then you can always move back.