It is extremely unlikely you will be SWAT-ed. Officially anyhow. Thing of it is, that is a measure reserved for those situations that call for immediate and swift action.
Which does not coincide with your own claim that they have nothing actionable on you.
Either they suspect you are guilty of something, something violent (in most cases, SWAT-ing does not apply to mere drug charges) and want to take you off the streets. Or... you are completely full of it as has been suggested by others.
My money is on you being full of it.
If the FBI disliked you to the point of sending a SWAT team to you, you probably did something to deserve it. They do not dislike individuals just for the heck of it. That would be the same as suggesting that the IRS is taxing individual people more than others just because.
There are laws governing the use of SWAT teams. Not even the FBI can break those laws.
So, really... just tell us, you've done something, right? No need to tell us exactly what that was. Just be honest. Either you're a criminal... or you're talking out of your ass. Well, third possibility... you might be suffering from mental health issues. You could be on the verge of a psychotic episode.
Paranoia is a really strong indicator of that. Please, seek professional help. Before you end up harming yourself.