What's the worry of terrorists training in Madrases

Apparently, there is a lot of concern over terrorists in Pakistan training children in Madrases. They are only pants. Sure, they are ugly pants, but who cares what terrorists wear when learning to hate. It might be good that they are in those pants because they'll be easier to spot.