I agree they'll dull faster. Fabric scissors are sharpened on a much lower angle, so if the metal doesn't have the sufficient hardness, they will not retain their edge for long.

I have expensive japanese knives, scissors, guillotine (no, not the historic french one) etc. I sharpen them myself every few months on whetstones. I'm not gonna overly worry about their usage because even at the rate at which I sharpen, they will likely last me a lifetime. Other people use my tools incorrectly often. I've seen my parents use Shun chef knife like a cleaver through fish & chicken bone. I'm sure it works very well. It's bad for the knife. But I just sharpen on my regular schedule and go on with my day instead of stressing about it.