By "we" I'm really thinking of all earth based life/intelligence, rather than just humans as they exist today. But yeah if humans self-delete in a way that doesn't involve being replaced by something similarly capable (for instance a planet of the apes type scenario), then it's probably going to be a lot longer than a million years before we recover, which could start to erode our cosmic timescale head start over life elsewhere in the universe. So we really shouldn't do that just yet.

Honestly given that we are a very intelligent generalist, I think it would be very hard to completely eradicate humans.

But I would agree that we could have a crazy bad collapse and have to start way over due to a much smaller habitable part of the planet and maybe that habitable area shifts around making us nomadic or something. That would probably make it a lot harder to redevelop tech. Source: https://www.open.edu/openlearn/nature-environment/environment-understanding-atmospheric-and-ocean-flows/content-section-4

Figure 18 shows that such a warm, stable period has been very unusual in the last 800 000 years, yet it is only during the Holocene that agriculture and the civilisations that rely on it have developed