I agree that the MQ is valuable, but many don’t know how to use it so they assume all of the evaluation research is now done for them. The MQ does not and should not be the ONLY tool used to create a short (or long!) list, and you’re right that there are many elements left off of the report. That said, it’s an important piece and we’re happy that you noted iCIMS is “making great strides and improving their market position.”

Everyone is desperate for some competition to Gartner in this market, but the “Big G” seems dead-set on buying up the competition, leaving vendors with little choice except to pony up the Quadrant dough.

Sad days indeed. Great post Mr C.

I would agree that we are seeing a growing gap in market research today.

Thanks for your comment.

I think the MQ is too much based on theory and not enough practice. I don’t know if the analysts have actually used any of the products or spoke to many customers but based on their results I’d suggest not.

I continually work with many ATS vendor products from an operational and technical aspect and find them lacking in many areas. The MQ as I can see is of little use in determining a supplier. That may sound somewhat arrogant but based on my own experience I’ll stand by what I say.

I think your post raises some good questions about the MQ but you quote the analysts as “two of the brightest and most knowledgeable guys in the industry that ooze credibility” yet then go onto to highlight obvious flaws in the MQ as a guide to selecting a vendor. I agree with your points you make which bring into question how valid the MQ really is.

I will read the full report and do a more detailed blog post and review my comments here accordingly.

Peter

Gimmicky if you ask me.

I agree that Jim is very sharp and knows the space. There is a long tail of vendors out there who don’t participate for various reasons, and the truth is that this market is a lot more complex than vendors, analysts, and customers often appreciate.

I’d give the research a more serious name and orient it toward looking at why people buy what they buy. Knowing which kinds of end-users tend to end up with which solution is probably more useful than understanding the individual attributes of the various available solutions stacked up in a quadrant.

Larry Perlstein
Gartner Ombudsman