Last year (OK it was just a week or so ago) I wrote a post about SC Magazine Labs and their recent coverage of an OEM’ed NAC product which they were heaping accolades on as if it was the greatest thing since sliced bread. Well OK, just one of the top 20 products of the last 20 years!
As I said in that article, I have a lot of respect for the SC Magazine and the folks that run it. Illena Armstrong and staff do a great job of turning out a great product month in and month out, year after year. They have tried to be a force of good in the security market. That is why it was particularly out of character for the Veri-NAC stuff.
I also know that Illena and others at SC Mag read my blog. I figured it was just a matter of time until someone responded. Illena responded today with a comment on the follow on article to the original post. I think it is important enough to give it center field play. Here is her response in its entirety:
For the benefit of this blog's readers, I wanted to take a moment to provide some quick facts about SC Magazine's product reviews.
Our testing methodology is published each month in the Product Reviews section of our magazine. Additionally, on our website (www.scmagazineus.com) you can find even more documents about our Group Tests, such as our FAQs, How We Test, and a sample of our submission form that vendors must fill out in order to have their products considered for inclusion in any of our monthly tests. (Just check out the Product section's "About Reviews" link.)
As background on our regularly published reviews, typically following a two- to three-month lead time, we usually include at least two Group Tests in each edition that cover particular product categories of interest to our readers. Reviews, as described on our website and in the monthly magazine, are not bake-offs. Rather, ratings of products are achieved by testing individual solutions against our standard set of criteria. To expound further, we have a general set of criteria that we expect to be met in our reviews and, with each test, we send out submission forms that provide a little bit more explanation about the criteria for the particular class of products on test at that time. So, there are some specific criteria that are peculiar to both the category and product type, which change somewhat from product group to product group.
Now, we do not generally discuss those in great detail because that would allow a vendor to “prepare” a product to perform well in the review even if it is not as good a performer in a production environment. By noting general expectations, we offer a level playing field for all group review participants to ensure fairness. As well, a product under test should reflect what a buyer would experience.
As for the vendors included in each regular Group Test, we try to cover as many appropriate products as possible. With the start of each test, we review companies whose products we've already tested and research the space to add any other companies to the list whose products may fit the topic at hand. So, we contact all the vendors that might fit a particular category being tested and also consider those who approach us directly. Some vendors may choose not to participate because of product release dates. Others, after filling out submission forms, may not meet our criteria for that particular test. In short, there are various reasons why this vendor or that one may not make it into a particular Group Test. From our perspective, however, the more the merrier.
As for the annual Innovators issue, this is not a group review edition. We look at our potential innovators from a variety of angles. First, we look for innovative technology. This very often appears in small organizations, but not always. Second, we look for innovative marketing and business practices. A neat product is not worth much if it never gets into the marketplace. Peter's pretty clear about that in his product opener: “As in previous years, my formula for selection was a mix of technical and business innovation.” And, often these innovators have carved out a very specialized market space for themselves.
Overall, when you read the full Innovators issue – our third annual one – you should get the flavor of what we were looking for and what we are trying to accomplish in this yearly offering. We're calling out those players in the market who are demonstrating innovation in their overall company missions, their corporate and strategic planning, and the products they're offering. These vendors are chosen by us -- the editorial staff -- prior to even being notified of their selection. We then conduct interviews for this annual Innovators section to get the thoughts of the company’s visionaries, not to perform the review -- a fact that is explained in the introduction.
All our reviews are objective and well-researched. Indeed, our product reviews section, other special editorial sections and various features have won accolades from the Association of Business Publication Editors over the last couple years -- another fact we've touted both in the pages of our monthly edition and on our website.
I encourage all of you to hit the SC Magazine website for accurate information about how the content for our publication and its associated properties is gathered and published. And, if you have additional questions or comments about SC Magazine, its website, its other special publications, or its live and online events, you can contact me directly by emailing me at illena.armstrong@haymarketmedia.com or by calling me at (508)278-9768.
Thank you for your time.
Illena Armstrong
Editor-in-Chief
SC Magazine
I don’t doubt or dispute anything Illena says. However, I will stick by my original assertion. SC Magazine lab personnel were very well aware that this product is an OEM of another product. They thought it was a “big deal” for the company that developed the underlying product and were helping him out. By the authors own admission, he “stopped the presses'” to add this product as an honorable mention for innovation. At the very least they had an obligation to state it was an OEM. Also explain how an OEM’ed product would result in tremendous innovation, let alone being one of the top 20 products of the last 20 years.
Illena, I seriously have the utmost respect for you and all the folks at SC Magazine. But having this product featured in 4 consecutive issues without some more disclosure around it should have raised some serious flags in your process.
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=6429d9fd-8eda-4195-9665-3208e933777f)
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=b6aeacf5-22ed-4e1b-8530-dea69e42e884)

![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=54249354-c59e-4d4b-a162-d7e0cc4f6f0e)
![Reblog this post [with Zemanta]](http://img.zemanta.com/reblog_e.png?x-id=287d681f-484b-4ffd-a470-eda461f8abce)



