Jacob, I think you've done to much study in this area to really mean that statement in such sweeping terms. The only two texts that speak about Nephilim (both of which are somewhat cryptic) can easily be understood in a different sense (probably several different senses).
Numbers 13:33 does not necessarily say that the Anakites were descended from the Nephilim: it says they were "of the Nephilim" (
min hannephilim), which is the classic way to describe members of a class (see e.g.
Lev. 1:3,
10 etc). That is, they shared the characteristics of the Nephilim in being extremely tall and terrifying. "Descended from" typically uses the pual of
yld (
2 Sam 21:20,
22), a point that is all the more relevant since your theory (though not all scholars) wants to connect the
rephaim mentioned in these verses with the
Nephilim. See Timothy Ashley in the NICOT for a similar view.
So it would be more accurate to say, "according to some interpretations of the data, this is what the Bible is saying". It's true that there are some scholars who agree with you, but it isn't simply "a plain reading of the text" (whatever that may be).