Re: "Big data" - does it have anything to do with knowledge management? #data-science
Matt:toggle quoted messageShow quoted text
With regard to "bid data" and KM, I share your consternation and confusion. Using the term data, for example, conjures for me flowchart symbols for databases, or a SQL Server Admin interface. And big--it conjures mainly hype, as you noted.
That said, I have been engaged in a technology project that involves exploring some new technology approaches to KM--particularly in the realm of adopting NoSQL databases and MapReduce techniques. This is an example where we have been exploring application of some of these emerging technologies and how they engulf some of our common conceptions about how and where data are stored and accessed. Moreover, it has an impact on some of the basic models that people concerned with KM uses , e.g.,search and findability, structuring, sorting, and tagging, etc. A whole new world of capabilities is coming on lone. It's very exciting in terms of potential. but understand that the technology is still raw and it reveals its secrets reluctantly.
As noted, when I see the word data, I'm thinking of databases as a single thing. I'm not thinking so much the processes that create the data, the interactions the data represents, or the means by which the data is transformed into knowledge or insight--something I now know as a result of arranging the content of the data and displaying it in a particular way that I didn't know before. That said, I think it's useful to tease apart the three main phases of a "bid data" model:
- Rendering and storage
- Access, analysis and output
Again, from a grunt-level technology perspective, you can see how this is vital. But from a KM perspective, we can now drop sensors into many more parts of the organization, from the log file level on up, to start to get some insight.
The key notion from "big data" is actually the analytics part--the analysis and output component. Yo can envision systems that provide near-real-time indicators of a variety of signal from low levels that can be statistically analyzed to show demonstrable and valid lift in performance. You can then use these indicators as a means to dive into the knowledge base of that group--everything is stored and tracked and accessible and render-able. It changes the perspective on the performance management game.
= Joe Raimondo =
--- In sikmleaders@..., Matt Moore wrote: