Making Sense of a Fragmented Market: Selecting Text Analytics Software for Company B’s Engineering Services Division.

About the Client

Company B is one of the world’s most diversified healthcare companies, operating through consumer products, pharmaceutical, and medical devices and diagnostics segments under a long-standing decentralized management model. The company’s Engineering Services Division supported technical and knowledge-intensive functions across that global footprint, and in the early 2000s was exploring how emerging text analytics technology could help engineers and analysts make sense of a rapidly growing volume of internal and external unstructured content.

Industry Context

Text analytics — then more commonly called text mining — was an emerging discipline in 2001, populated by a wide range of vendors including Autonomy, Verity, Inxight, and Convera (formed that year from the merger of Excalibur Technologies and Intel’s Interactive Services division), alongside dozens of smaller specialists. Analyst firms had only begun to formally track the category, and no dominant standard or product taxonomy yet existed — functionality ranged from categorization and summarization to visualization, indexing, and automated routing, often bundled inconsistently across otherwise similar-sounding products. For a large enterprise like Company B, that fragmentation created real decision risk: without an objective framework, an IT investment could easily lock the Division into a narrow point solution that failed to address its broader unstructured-content needs.

Current Situation

The Division’s Head of Knowledge Management wanted a comprehensive overview of the text analytics field and a clear understanding of the features and functions of the more novel commercially available products, as a foundation for future technology investment. With no established market leaders and no internal precedent for evaluating this class of software, the Division turned to Iknow to conduct an independent, vendor-neutral software product assessment.

• A young, highly fragmented software category. The commercial text analytics market was crowded with vendors, had no established leaders, and lacked common standards or accepted product classes.
• Diverse, inconsistently described functionality. Products described themselves inconsistently, making it difficult to compare offerings or understand what functionality a given tool actually delivered.
• No framework for matching needs to vendors. The Division had multiple potential applications in mind — competitive intelligence, report mining, knowledge repository population — but no framework for matching vendor capabilities to those specific business needs.
• High risk of a premature, poorly matched investment. Committing to a point solution without independent analysis risked an IT investment that solved one narrow problem while leaving the Division’s broader unstructured-content needs unaddressed.

• Deliver a comprehensive overview of the commercial text analytics field, including its major functional categories.
• Identify and evaluate the features and functions of the most novel and relevant commercially available products.
• Produce a vendor-neutral, evidence-based analysis to support the Division’s IT investment decisions.
• Validate research findings with hands-on evaluation of select software products, not vendor claims alone.

How Iknow Structured the Work

Iknow structured the engagement as a broad-to-narrow market assessment: starting with an industry-wide scan to map the full competitive landscape, organizing that landscape into functional categories, then progressively narrowing to detailed reviews and hands-on evaluation of the products most relevant to the Division’s needs — reflecting Iknow’s vendor-neutral platform and vendor selection methodology.

Key Activities & Decisions

• Industry scan and secondary research. Iknow conducted a broad industry scan, drawing on research reports from for-profit analyst firms such as Company M and another analyst firm and nonprofit research organizations such as MITRE, published academic journal articles, vendor websites, and product documentation.
• Comprehensive market scan. Iknow reviewed more than 65 distinct software packages containing one or more text analytics or content management features, casting a deliberately wide net before narrowing the field.
• Category framework development. Iknow grouped the products into seven functional categories — taxonomization, categorization and metadata creation; summarization; indexing and search of unstructured data; visualization and mapping of unstructured data; other text analysis applications such as language identification; notification and routing; and text analysis tool suites — creating a common vocabulary the Division could use going forward.
• Detailed product reviews. Iknow selected roughly 40 products for detailed review based on their distinctive capabilities, drawing on vendor marketing materials, websites, independent third-party reviews, and direct discussions with vendor representatives.
• Hands-on software evaluation. For a subset of the most promising products, Iknow conducted hands-on evaluations rather than relying solely on vendor claims or published reviews, validating real-world functionality against the Division’s use cases.
• Use-case alignment. Iknow connected its category framework and product reviews to the Division’s stated priorities — competitive intelligence from published news feeds, automatic extraction of content from internal reports, and automatic population of internal knowledge repositories — so findings translated directly into investment guidance.

Stakeholders & Collaboration

Iknow served as prime contractor, working directly with the Engineering Services Division’s Head of Knowledge Management, who sponsored and directed the assessment, with no subcontractors involved.

Bringing Order to a Market With No Shared Vocabulary

With more than 65 products spanning wildly different functionality and no accepted product classes, a simple vendor-by-vendor comparison would have left the Division no better equipped to make a decision than before the assessment began. Iknow addressed this by developing its own seven-category functional framework, independent of any single vendor’s marketing language, giving the Division a consistent structure for comparing otherwise incomparable products.

Separating Vendor Claims From Verified Functionality

In an emerging category with no established leaders, vendors had strong incentives to overstate capability, and published reviews varied widely in rigor. Iknow addressed this by triangulating multiple independent sources — analyst research, academic literature, and direct vendor discussions — and, for the most promising candidates, conducting its own hands-on evaluations rather than taking vendor or marketing claims at face value.

Quantitative Outcomes

• Market coverage: More than 65 distinct software products screened across the commercial text analytics market.
• Category framework: A seven-category functional taxonomy developed to organize the market.
• Detailed reviews delivered: Roughly 40 products received detailed written reviews based on their distinctive capabilities.
• Hands-on validation: Several finalist products received direct, hands-on functional testing beyond documentation and vendor claims.
• Engagement duration: Six-month assignment.

Qualitative Outcomes

Iknow’s research gave the Engineering Services Division an objective, vendor-neutral foundation for its IT investment decisions in an area where internal teams had no established evaluation framework of their own. The seven-category taxonomy gave Division stakeholders a shared vocabulary for discussing text analytics capability, reducing the risk of an investment decision driven by vendor marketing rather than genuine fit with the Division’s use cases. By grounding its findings in the Division’s specific priorities — competitive intelligence, report mining, and knowledge repository automation — Iknow ensured its research translated directly into actionable investment guidance rather than an abstract survey of the market.

Timeline to Impact

Iknow delivered its market scan, category framework, and detailed product reviews within the six-month engagement, giving the Division’s Head of Knowledge Management a complete, ready-to-use evidence base to support IT investment decisions as soon as the assessment concluded.

Core Skills

• Vendor-neutral software and platform evaluation
• Enterprise search and text analytics advisory
• Market and competitive research
• Technology category framework development

Methods & Frameworks

• Broad-to-narrow market scanning methodology
• Functional category taxonomy development
• Hands-on product validation

Technologies & Tools

• Commercial text analytics and content management software (categorization, summarization, indexing and search, visualization, routing)