Here's why:
* Adverbs modify verbs, adjectives, or other adverbs.
* Physically describes how something is done or experienced.
For example:
* "He physically attacked her." (modifies the verb "attacked")
* "She was physically exhausted." (modifies the adjective "exhausted")
* "He ran physically faster than anyone else." (modifies the adverb "faster")