Skip to content
Iknow

Architecting the Next Generation of Content Intelligence.

Global financial news and information company · Media & Entertainment

Designing a Services-Oriented Metadata Processing Platform and an Implementation Roadmap to Machine Reasoning

Executive summary

Company N is one of the world’s largest publishing and financial information providers, aggregating and automatically processing more than one million news articles every day. In mid-2010, Company N formally launched its Core Platform Improvements Initiative, a multiyear program to expand the quantity and types of metadata extracted from source content. Company N wanted to more accurately analyze, categorize, and tag a much greater number of people, companies, organizations, and brands, and to add richer metadata, such as granular regional tagging and sentiment, to every article. As the first step of that initiative, Company N selected Iknow to lead the creation of a comprehensive metadata strategy and implementation roadmap.

Iknow reviewed Company N’s core information processes, engaged executives to define a future-state architectural vision, benchmarked current performance, and identified and prioritized process reengineering opportunities. Iknow developed a comprehensive metadata strategy organized into eight recommendation areas, including a services-oriented metadata processing workflow spanning document pre-processing, text analysis, concept identification, and word and phrase disambiguation, plus meaning-based capabilities such as sentiment, events, aboutness, credibility, and inference analysis. Iknow also designed a three-component technology platform — a Metadata Processing Layer, more than 20 Metadata Processing Services, and a set of Authority Files — and recommended a three-phase, multiyear roadmap progressing from foundational entity and concept tagging through fact and relationship extraction to simulated human reasoning. Company N is currently implementing Iknow’s recommendations.

Background & context

About the Client

Company N is a global news and information company.

Industry Context

For a publisher processing more than one million articles daily, the accuracy and richness of automatically extracted metadata directly determines product quality, since customers rely on precise entity tagging plus deeper signals like sentiment and regional relevance to search, filter, and monitor the content that matters to them. By 2010, natural language processing and entity extraction technology had matured enough to support increasingly sophisticated automated tagging, but the underlying software was still early in its lifecycle, meaning organizations attempting large-scale metadata enrichment needed genuine platform architecture discipline — services-oriented design, authority files, orchestration layers — rather than simply bolting on point solutions. Moving from basic entity extraction toward higher-order capabilities like event analysis, credibility analysis, and simulated reasoning represented the leading edge of content intelligence at the time, foreshadowing capabilities that would later become central to natural language AI.

Current Situation

The first step in the Core Platform Improvements Initiative was to develop a comprehensive strategy and roadmap for the creation and use of metadata and ontologies. Company N asked Iknow to lead the creation of a strategy and roadmap to expand the types and quality of metadata assigned during content processing.

This engagement ran alongside a parallel effort in which Iknow helped Company N build a broader project prioritization framework for its IT portfolio, applied specifically to the roughly three dozen candidate projects that made up the metadata and content architecture work described here.

Problem / challenge

  • Metadata coverage falling short of content volume and complexity. Company N processed more than one million news articles daily, but existing metadata extraction did not capture the full range of people, companies, organizations, and brands present in that content.
  • Missing higher-order metadata capabilities. The company lacked additional layers of metadata, such as granular regional tagging and sentiment analysis, that its products and services increasingly required.
  • No baseline understanding of current processing capacity. No documented view of current information-processing capacity, performance, or constraints existed across Company N’s core content-processing systems.
  • No unifying strategy for metadata investment. Company N needed a coherent, multiyear strategy and roadmap for metadata and ontology creation, not a series of disconnected point improvements.

Project objectives

  • Understand current and future-state information processing needs for existing and planned products and services.
  • Conduct a detailed review of Company N’s core information processes, including performance and capacity constraints.
  • Develop a comprehensive metadata processing strategy spanning workflow and technology architecture.
  • Deliver a multiyear implementation roadmap with timelines, milestones, and resource requirements.

Iknow’s approach

How Iknow Structured the Work

Iknow structured the engagement around current- and future-state process review, executive-engaged visioning, benchmarking and gap analysis, and a comprehensive strategy translated into a phased roadmap — reflecting Iknow’s metadata strategy and schema design methodology for grounding an ambitious content intelligence vision in a realistic, sequenced technical architecture.

Key Activities & Decisions

  • Current and future-state needs assessment. Iknow worked to understand the current and future-state information-processing needs for Company N’s existing and planned products and services.
  • Core process review. Iknow conducted a detailed review of Company N’s core information processes, including detailed information flow charts and process models, a current performance assessment, and estimates of current hardware and software capacity constraints.
  • Executive visioning and benchmarking. Iknow engaged executives in identifying future-state architectural options and defining a future-state vision, then compared current content processing application performance against available benchmarks to identify performance gaps.
  • Process reengineering and implementation planning. Iknow identified and prioritized process reengineering opportunities, redesigned existing processes as appropriate, and developed the optimal implementation approach, including timelines, milestones, and resource requirements.
  • Metadata strategy and platform design. Iknow developed a comprehensive metadata strategy organized into eight recommendation areas, including a services-oriented metadata processing workflow and a three-component technology platform, and recommended a “best of breed” approach to incorporating commercial software given how early the underlying technologies were in their lifecycles.
  • Three-phase implementation roadmap. Iknow developed a three-phase, multiyear roadmap progressing from foundational entity and concept tagging, through fact, relationship, and sentiment extraction, to simple inferences and simulated reasoning.

Stakeholders & Collaboration

Iknow served as prime contractor, working directly with Company N executives to define the future-state vision and with Company N’s technical and content teams throughout the process review and strategy development.

Challenges & how Iknow overcame them

Designing Sophisticated Content Intelligence at Massive Scale

Building real content intelligence — disambiguation, sentiment, events, reasoning — while remaining practical to run across more than one million articles a day required more than a single monolithic engine. Iknow addressed this by designing a services-oriented architecture that decomposed metadata processing into more than 20 discrete, orchestrated services plus authority files, allowing capability to be added and improved incrementally rather than requiring a single, all-encompassing solution.

Avoiding Lock-In to Still-Maturing Technology

Committing to specific commercial software risked stranding Company N with tools that would soon be outpaced, since the underlying natural language processing technologies were still early in their lifecycles. Iknow addressed this by recommending a “best of breed” approach that embedded replaceable, best-in-class commercial components into the platform architecture rather than a single vendor solution, and by sequencing the three-phase roadmap so foundational capability came before more advanced, less mature capabilities like reasoning and inference.

Results & impact

Quantitative Outcomes

  • Process review delivered: A comprehensive review of Company N’s core information processes, covering process flow, performance, and capacity constraints.
  • Strategy scope: A metadata strategy organized into eight recommendation areas.
  • Platform architecture delivered: A three-component technology platform designed, including more than 20 Metadata Processing Services.
  • Processing workflow defined: A four-step document-level metadata workflow, plus five additional meaning-based processing capabilities.
  • Roadmap delivered: A three-phase, multiyear implementation roadmap delivered.
  • Engagement duration: Four-month assignment.

Qualitative Outcomes

Company N is currently implementing Iknow’s recommendations, genuine, ongoing evidence that the strategy and roadmap translated directly into an active, funded, multiyear implementation program rather than a shelved report. The metadata strategy gave Company N both an immediate technical blueprint — the processing workflow and platform architecture — and a longer-term vision that progressed from basic entity extraction toward simulated reasoning, providing the company with the guidance it needed for a genuinely multiyear content intelligence transformation.

Timeline to Impact

Within the four-month engagement, Iknow delivered the full current-state review, metadata strategy, technology platform design, and three-phase roadmap, and Company N moved directly into implementing the recommendations following the engagement’s conclusion.

Iknow’s capabilities demonstrated

Core Skills

  • Metadata strategy and schema design
  • Content processing architecture design
  • Natural language processing capability roadmapping
  • Services-oriented technology platform design

Methods & Frameworks

  • Current- and future-state information process review
  • Executive-engaged future-state visioning
  • Multiyear phased implementation roadmapping

Technologies & Tools

  • Services-oriented metadata processing architecture
  • Entity extraction, disambiguation, and taxonomy application

Put this experience to work on your problem.

Much of our work never reaches the website. Book a call, tell us your sector and we will walk you through the engagements that map to yours.