Knowledge Mining


One of the things that always grabs my interest is all kinds of knowledge tools:

  • Desktop Search Engines
  • Knowledge Tools like
  • Flow
  • DEVONthink
  • StickyBrain
  • WiKi engines
  • Outliners, MindMaps and other “List” tools * … and many more

All these products are fine, fulfil their intended use, even share common traits, but everyone also has its limits:

Desktop Search Engines#

Desktop Search Engines simply deliver search results from their indices, not less but not more as well. They help me find content fast, but I must know what I search for – or what exactly I need.

Knowledge Tools#

All the Knowledge Tools we have at our fingertips are cool, some have better design patterns than others, but that’s not the point here. But every one of these also requires me to change my habits and workflows when I want to efficiently use them:

  • I must start to re-index all my mail conversation, if not import all mails from time to time
  • I must manually add every single document I want to mine for knowledge * I basically must make the software my digital hub


Wikis, then, are a great tool, too. But here, adding external resources is mostly a clumsy process: Of course, I can link PDF and Word files (or XML, if you want :)), but the content is simply linked, no additional knowledge is taken from the relationships I define by adding a link to a certain file to a page about a certain subject.

That is, they provide very intelligent and intuitive hyperlinking, but not before I told them to do so.


Last but not least, we have all these great outlining apps out there, bringing some kind of structure to information, helping people better achieve their goals by presenting lists of things. It’s no wonder that almost every efficient productivity tool or “theory” falls in this category: Mind Maps, Outliners, GTD, Task lists …

##… but

Nevertheless, there’s little to no additional knowledge leveraged in all these tools. They know what you tell them, show them to index or manually link to them. But somehow, every single “productivity” tool out there in the world is, well, an autist tool: Completely immersed in a world of their own, powerful in but limited to a very specific subject (Search, outline, manage data) or simply too limited to find interesting knowledge themselves.

##… there’s hope …A rather big company, called Autonomy has a very interesting product called Active Windows Extensions:

Active Windows Extensions (AWE) automatically links users with relevant information they require, accurately, in context and in real time without the user being needlessly diverted from their work in progress to perform a search or retrieval operation.

The solution adds unobtrusive icons to the title bar of Windows applications. As you write a document, create a presentation, surf the web or write e-mail messages, AWE automatically conducts a real-time analysis of the ideas involved and suggests relevant documents, which you can view by clicking on the icons.

As a user writes a document, creates a presentation or writes e-mail messages, Active Windows Extensions conducts a realtime analysis of the ideas involved and provides links to relevant internal and external information, automatically.

Unobtrusive Knowledge#

This is tool certainly handy in a corporate environment, right, but you could equally apply this to a personal workstation: Instead of conducting searches in any of the apps I mentioned above, you simply go and get the relevant content, without even searching …

And I think, that Spotlight would be the ideal base for this:

  • It builds a comprehensive, up-to-date index - no spidering is necessary * It can be extended to include App-specific formats - *I can keep working in my preferred apps* * It has the inherent knowledge of every object on my computer - *no need to manually add items* * It can return structured information, enriched with metadata - *no need to manually assign relationships*

If someone thus applied the concept of Active Windows Extensions to a nice little Spotlight plugin, we could see an Knowledge Mining Tool that is finally worth its name. Instant, context-sensitive search results wherever and whenever I need them.

Add some spiffy visualisation layer and you can start analysing your knowledge behaviours, can create topic maps and – finally – use all these spiffy tools that exists to give form to statistics.

I’m waiting … :)


No comments. Be the first to add one!
Add a comment.
We'll never share your email with anyone else. We use the Gravatar system to pull in pictures based on an anonymous hash.
Once you submit your comment, it will be moderated and then show up here shortly after.