I also worked as a canvasser in 2019 and 2020 for the US census and, while we were about as thorough as you could reasonably get, the whole operation made me somewhat skeptical of official statistics in general. 2020 in particular was a bit of a disaster due to the pandemic and when the statistics were published, a bunch of mainstream news outlets published stories about certain areas experiencing "population decline" and all I could think was that those were actually the areas where the census didn't manage to count everyone.
"Just" is doing a lot of work in that sentence!
A human female can have sex once and pop out a new human 9 months later regardless of her connection to any official social systems or state apparatus. She could disappear into the woods as a hermit and produce a completely uncounted unknown new person.
To the degree that that doesn't happen, it's because a country has spent generations building a giant high trust society with good widely available medical infrastructure and a culture where almost everyone believes it is better to use that than to go it alone. Building that system requires the powerless to organize themselves and counterbalance the powerful elite who otherwise have a tendency towards despotism and corruption. That in turn requires a lot of shared culture so that the powerless feel they are all one tribe and not fractured out-groups (a reality the elites are constantly incentivized to manufacture). You need good education, mobility, safety.
An easy census is the very pinnacle of a successful society and only in a few places in the recent past has any country reached it.