You're probably not alone, but I don't think that opinion is popular, either. The reason why many people associate loud engines with powerful (IC) engines is because powerful engines, such as those found in racing cars, are loud. Often very loud. It's also not possible to make them quiet without sacrificing performance.

If you meant to say that you don't think much of IC engines in general, you could've just called them inefficient and be done with it.