If I just upgrade to the latest version (by flashing) and not install mind the gapps, is it basically a degoogled phone?
It would probably have to be a clean install that wipes userdata, not an upgrade. But yes, LineageOS is pretty much as degoogled as you can get on an OS forked from Google's AOSIP, if you don't explicitly add GApps.
German privacy researcher Mike Kuketz does not agree, but it all depends on how much effort you're willing to put into degoogling, or how much you're willing to compromise on usability.