Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads? #metrics #value
Details are in How to motivate knowledge sharing using gamification, goals, recognition, and rewards
At HP we created an online threaded discussion called the Reuse Stories Forum and encouraged people to post stories about how they benefited from reusing knowledge. Every month we selected one contributor who had posted such a story to be recognized as one of four monthly KM Stars. |
|
This is a very helpful thread for me. Where can i find "reuse stories submitted monthly and “Stars” awards" by Stan? Any leads or links to it please!
-- Vandana W |
|
Lee Romero
For what it's worth - being successful with a tool like SiteCatalyst
toggle quoted message
Show quoted text
(with which I'm quite familiar) is dependent on what you're trying to track. I think this thread originally started out with a question about metrics on document downloads. If so, SiteCatalyst *can* do that to some extent, but it is dependent on the injection of JavaScript into web pages for its data collection, so in the case of document downloads, SiteCatalyst only captures metrics on downloads coming from a web page that links to the document. If you have links to documents from pages without the SiteCatalyst JavaScript or if you or your users share links to documents through other means (emails or email newsletters are common for example), SiteCatalyst can not track those. The impact is that, for documents, you only capture a portion of your potential document downloads, not all of them. What that percentage is would be hard to gauge. If you have no links outside of your web site (perhaps your site makes it hard to get the URLs for individual documents in a way that can be shared), it will track all of them; if you have a lot of newsletters where you point directly to documents and not to a page the links to the document, you'll capture a much smaller percentage of downloads. SiteCatalyst is very good at web site metrics, though, and they provide a lot of flexibility in tying those metrics to campaigns you can define. Just don't think that if your interest is primarily in document downloads that you will get a very complete picture through a tool like this. Hope this is useful :-) Lee Romero On Jan 15, 2008 9:00 PM, <TPangakis@...> wrote:
|
|
Bernadette Boas <bernadette.boas@...>
Very interesting and definitely warrants a review. Thanks
Bernadette Boas
Make distant family not so distant with Windows Vista® + Windows Live™. Start now! |
|
Tara Pangakis
Hi all,
toggle quoted message
Show quoted text
Kate and I have been exchanging e-mail about Omniture SiteCatalyst for traffic monitoring of access points. To summarize: Adding some JavaScript to web pages (assuming a license with Omniture, of course), enables the sending of user data to a comprehensive data warehouse. Through path analysis, you can determine WHAT users choose and, applying skills and experience - you (the knowledge analyst) can theorize WHY they chose it and WHERE the gaps are, for a particular subset. Consider: http://www.omniture.com And: http://jordy.gundy.org/omniture-success-kit/ Tara Pangakis, PMP to HP
Systems Documentation, Inc.
(978) 821-5038
-----Original Message-----
From: Valdis Krebs To: sikmleaders@... Sent: Wed, 9 Jan 2008 7:01 pm Subject: Re: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits This is starting to sound like "The Social Life of Documents" -- who used what to create what-else for who-else? Re-use is a vote of value for the document and the person/people who created it. Valdis Krebs http://www.orgnet.com http://www.networkweaving.com/blog On Jan 9, 2008, at 6:10 PM, Bernadette Boas wrote: > John, > a question > I fully agree that the success stories and best practices that can > be shared is a much more valuable way to measure the value the > investment is making to the business. And that hits, visits, > searches, etc. do not tell you that; though they at least ensure > adoption and usage. > However, I have also had many people wanting to understand 'reuse' > of the documents made available, not to necessarily justify the > direct KM investment, but to ensure that the tangible IP knowledge > that is being provided (shared, stored, etc.) is of value; therefore > assuming it is being used to improve the business. That said, > unfortunately 'downloads' does not guarantee that the things being > downloaded are of true value of quality, completeness, etc... And > ratings and feedback are often viewed as subjective. > > Have you found any effective means of measuring true 'reuse'? > > Bernadette Boas > > bernadette.boas@... > > To: sikmleaders@... > From: john.mcquary@... > Date: Wed, 9 Jan 2008 21:55:47 +0000 > Subject: [sikmleaders] Re: Does anyone have tool for cleaning > reporting documentum (doc mgt system) hits and downloads? > > Kate, > > I would encourage you to look for additional methods to demonstarte > the value of knowledge sharing and collaboration. We do have > extensive usage statistics, but concentrating on them diminshes the > value of people-to-people connections. The usage metrics also tend > to drive to a cost savings perspective rather than a value generation > view. > > We use our usage metrics to demonstrate the level of activity in the > tool, and use success stories to convey the value being generated. > > Regards, > John McQuary > Vice President > Knowledge Management and Technology Strategies > > Fluor Corporation > One Fluor Daniel Drive > Sugar Land, TX 77478-3899 > > 281-263-2533 (w) > 281-263-2101 (f) > > --- In sikmleaders@..., "Pugh, Katrina" > wrote: > > > > Hi, all - > > > > We need to report the ROI for our entire knowledge management > system. At > > present, the tools of collaboration and document management are > loosely > > coupled. People will click through the web interface (which we can > > track) but access "certified" knowledge in the document management > > system. > > > > I would like to calculate the likely reuse value based on the > number of > > actual downloads (and search results) in Documentum, but the > challenge > > is that I'm hearing that "the tool was not made to do that type of > > reporting." The developers say that this would require capturing and > > storing the log file (very very big), and then writing code to do > siphon > > of our counts and metadata, and then generate reports off of it. > > > > That seems like unusually big expense for something that would seem > to > > me to be a very common problem among knowledge managers looking to > > measure the impact of document management repositories. Has anyone > seen > > or built a tool to do this? > > > > Thanks > > > > Kate > > > > > > > > Katrina Pugh > > VP, Knowledge Management > > IT Center of Excellence > > Fidelity Investments, Personal and Workplace Investing > > 400 Puritan Way M3J > > Marlborough, MA 01752 > > (O) 508 357 3236 > > (M) 781 258 0920 > > katrina.pugh@... > > Email <mailto:katrina.pugh@...> Confidentiality Notice: The > > information in this email and subsequent attachments may contain > > confidential information that is intended solely for the attention > and > > use of the named addressee(s). This message or any part thereof > must not > > be disclosed, copied, distributed or retained by any person without > > authorization from Fidelity Investments. > > > > > > Watch “Cause Effect,” a show about real people making a real > difference. Learn more Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/sikmleaders/ <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: http://groups.yahoo.com/group/sikmleaders/join (Yahoo! ID required) <*> To change settings via email: mailto:sikmleaders-digest@... mailto:sikmleaders-fullfeatured@... <*> To unsubscribe from this group, send an email to: sikmleaders-unsubscribe@... <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/ |
|
Bernadette Boas <bernadette.boas@...>
Thank you John, great input
Bernadette Boas 678-438-1908 bernadette.boas@...
Put your friends on the big screen with Windows Vista® + Windows Live™. Start now! |
|
john_mcquary <john.mcquary@...>
Bernadette,
If you want to measure use (or reuse), then usage statistics will suffice. If you want to measure value, then I think you have to look elsewhere. As Kate's developers pointed out, the statistics do take up space. In our case, the storage space of our usage statistics is roughly equal to the storage space of our content. As far as usage metrics go, we can glean/interpret a lot of information. Here are some examples from our system. Through the first 10 days of January, 36.3% of our almost 25,000 members have logged into the system at least once. Another 21.3% logged in in December, and 10% in November. Having 67.6% of the users access the system at least once in the last three months indicates a pretty good level of overall usefulness. We typically have about 400 documents downloaded daily. Of these, about 100 documents are downloaded by one person getting one document. The next 100 are one person getting 2 or 3 documents. I take this measurement to indicate that users can get into the system find what they need, download it, and get back to work. We know by knowledge object / document how often it has been downloaded, and by whom. Every user can see these statistics. Every piece of content also has a review date set with notifications. Part of the review process can include reviewing statistics for the document. We can also run reports on the top read or downloaded objects as well as the bottom. We have many other statistical reports that can help measure use, reuse, or usability, but these are independent of value measurement. Hope this helps, John McQuary Vice President Knowledge Management and Technology Strategies Fluor Corporation One Fluor Daniel Drive Sugar Land, TX 77478-3899 281-263-2533 (w) 281-263-2101 (f) --- In sikmleaders@..., Bernadette Boas <bernadette.boas@...> wrote: be shared is a much more valuable way to measure the value the investment is making to the business. And that hits, visits, searches, etc. do not tell you that; though they at least ensure adoption and usage. However, I have also had many people wanting to understand 'reuse'of the documents made available, not to necessarily justify the direct KM investment, but to ensure that the tangible IP knowledge that is being provided (shared, stored, etc.) is of value; therefore assuming it is being used to improve the business. That said, unfortunately 'downloads' does not guarantee that the things being downloaded are of true value of quality, completeness, etc... And ratings and feedback are often viewed as subjective. +0000Subject: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads? demonstarte the value of knowledge sharing and collaboration. We do have extensive usage statistics, but concentrating on them diminshes the value of people-to-people connections. The usage metrics also tend to drive to a cost savings perspective rather than a value generation view.We use our usage metrics to demonstrate the level of activity in the tool, and use success stories to convey the value being generated.Regards,John McQuaryVice President Knowledge Management and Technology StrategiesFluor CorporationOne Fluor Daniel DriveSugar Land, TX 77478-3899281-263-2533 (w)281-263-2101 (f)--- In sikmleaders@..., "Pugh, Katrina" <katrina.pugh@> wrote:>> Hi, all -> > We need to report the ROI for our entire knowledge management system. At> present, the tools of collaboration and document management are loosely> coupled. People will click through the web interface (which we can> track) but access "certified" knowledge in the document management> system. > > I would like to calculate the likely reuse value based on the number of> actual downloads (and search results) in Documentum, but the challenge> is that I'm hearing that "the tool was not made to do that type of> reporting." The developers say that this would require capturing and> storing the log file (very very big), and then writing code to do siphon> of our counts and metadata, and then generate reports off of it. > > That seems like unusually big expense for something that would seem to> me to be a very common problem among knowledge managers looking to> measure the impact of document management repositories. Has anyone seen> or built a tool to do this? > > Thanks> > Kate> > > > Katrina Pugh> VP, Knowledge Management> IT Center of Excellence> Fidelity Investments, Personal and Workplace Investing> 400 Puritan Way M3J> Marlborough, MA 01752> (O) 508 357 3236> (M) 781 258 0920> katrina.pugh@> Email <mailto:katrina.pugh@> Confidentiality Notice: The> information in this email and subsequent attachments may contain> confidential information that is intended solely for the attention and> use of the named addressee(s). This message or any part thereof must not> be disclosed, copied, distributed or retained by any person without> authorization from Fidelity Investments.> difference. http://im.live.com/Messenger/IM/MTV/?source=text_watchcause |
|
Pugh, Katrina <katrina.pugh@...>
John – I completely agree. Absolutely, we are tracking both quantitative and qualitative measures (and rich success stories). We’re even preparing to use the concept from Stan Garfield of having reuse stories submitted monthly and “Stars” awards.
The concern here is getting this part of the “quantitative” side. We’re learning about the constraints of usage metrics in Documentum.
Kate
Katrina Pugh From: sikmleaders@...
[mailto:sikmleaders@...] On
Behalf Of john_mcquary
Sent: Wednesday, January 09, 2008 4:56 PM To: sikmleaders@... Subject: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads?
Kate, |
|
Valdis Krebs <valdis@...>
This is starting to sound like "The Social Life of Documents" -- who
toggle quoted message
Show quoted text
used what to create what-else for who-else? Re-use is a vote of value for the document and the person/people who created it. Valdis Krebs http://www.orgnet.com http://www.networkweaving.com/blog On Jan 9, 2008, at 6:10 PM, Bernadette Boas wrote:
John, |
|
Bernadette Boas <bernadette.boas@...>
John,
a question I fully agree that the success stories and best practices that can be shared is a much more valuable way to measure the value the investment is making to the business. And that hits, visits, searches, etc. do not tell you that; though they at least ensure adoption and usage. However, I have also had many people wanting to understand 'reuse' of the documents made available, not to necessarily justify the direct KM investment, but to ensure that the tangible IP knowledge that is being provided (shared, stored, etc.) is of value; therefore assuming it is being used to improve the business. That said, unfortunately 'downloads' does not guarantee that the things being downloaded are of true value of quality, completeness, etc... And ratings and feedback are often viewed as subjective. Have you found any effective means of measuring true 'reuse'? Bernadette Boas bernadette.boas@...
Watch “Cause Effect,” a show about real people making a real difference. Learn more |
|
john_mcquary <john.mcquary@...>
Kate,
I would encourage you to look for additional methods to demonstarte the value of knowledge sharing and collaboration. We do have extensive usage statistics, but concentrating on them diminshes the value of people-to-people connections. The usage metrics also tend to drive to a cost savings perspective rather than a value generation view. We use our usage metrics to demonstrate the level of activity in the tool, and use success stories to convey the value being generated. Regards, John McQuary Vice President Knowledge Management and Technology Strategies Fluor Corporation One Fluor Daniel Drive Sugar Land, TX 77478-3899 281-263-2533 (w) 281-263-2101 (f) --- In sikmleaders@..., "Pugh, Katrina" <katrina.pugh@...> wrote: system. At present, the tools of collaboration and document management areloosely coupled. People will click through the web interface (which we cannumber of actual downloads (and search results) in Documentum, but thechallenge is that I'm hearing that "the tool was not made to do that type ofsiphon of our counts and metadata, and then generate reports off of it.to me to be a very common problem among knowledge managers looking toseen or built a tool to do this?and use of the named addressee(s). This message or any part thereofmust not be disclosed, copied, distributed or retained by any person without |
|
Bernadette Boas <bernadette.boas@...>
Kate,
not sure of the tool you are using, but downloads, hits, visits, -0- search results, etc. should be common metrics captured by a content/km/document portal/repository application. It is unfortunate that yours does not provide it Measuring actual 'reuse' of downloaded tools is often not available, since it is believed that once a user downloads to their desktop the application loses linkage to the asset (unless you are using check in/out). But again customizing proprietary means of measuring inference of reuse should also be available. You would have to measure the cost of reporting to the value of the information toward usage - which is critical. Linda Hummel could provide you additional detail around this as well. Bernadette Boas bernadette.boas@...
Get the power of Windows + Web with the new Windows Live. Get it now! |
|
Pugh, Katrina <katrina.pugh@...>
Hi, all – We need to report the ROI for our entire knowledge management system. At present, the tools of collaboration and document management are loosely coupled. People will click through the web interface (which we can track) but access "certified" knowledge in the document management system. I would like to calculate the likely reuse value based on the number of actual downloads (and search results) in Documentum, but the challenge is that I'm hearing that "the tool was not made to do that type of reporting." The developers say that this would require capturing and storing the log file (very very big), and then writing code to do siphon of our counts and metadata, and then generate reports off of it. That seems like unusually big expense for something that would seem to me to be a very common problem among knowledge managers looking to measure the impact of document management repositories. Has anyone seen or built a tool to do this? Thanks Kate
Katrina Pugh
|
|