That's not weird at all, but a very common cyclist's problem. Google "Chondromalacia" for plenty of info.
I suffered from this many years ago, when I was a racer. The only thing that helped, apart from giving up cycling, was to always spin on very, very low gears,instead of
pushing hard on the pedals like I used to do. You can also do some cross training. Running and swimming does not put the kneecaps under pressure like cycling does