mining difficulty adjusts based purely on hashrate and fees are set by user demand for block space

lower fees does not mean lower difficulty, there is not even a correlation, forget about a causation