Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads? #metrics #value


Stan Garfield
 

Details are in How to motivate knowledge sharing using gamification, goals, recognition, and rewards

At HP we created an online threaded discussion called the Reuse Stories Forum and encouraged people to post stories about how they benefited from reusing knowledge. Every month we selected one contributor who had posted such a story to be recognized as one of four monthly KM Stars.


Vandana Wadhawan
 

This is a very helpful thread for me. Where can i find "reuse stories submitted monthly and “Stars” awards" by Stan? Any leads or links to it please! 
--
Vandana W


Lee Romero
 

For what it's worth - being successful with a tool like SiteCatalyst
(with which I'm quite familiar) is dependent on what you're trying to
track.

I think this thread originally started out with a question about
metrics on document downloads. If so, SiteCatalyst *can* do that to
some extent, but it is dependent on the injection of JavaScript into
web pages for its data collection, so in the case of document
downloads, SiteCatalyst only captures metrics on downloads coming from
a web page that links to the document.

If you have links to documents from pages without the SiteCatalyst
JavaScript or if you or your users share links to documents through
other means (emails or email newsletters are common for example),
SiteCatalyst can not track those.

The impact is that, for documents, you only capture a portion of your
potential document downloads, not all of them. What that percentage
is would be hard to gauge. If you have no links outside of your web
site (perhaps your site makes it hard to get the URLs for individual
documents in a way that can be shared), it will track all of them; if
you have a lot of newsletters where you point directly to documents
and not to a page the links to the document, you'll capture a much
smaller percentage of downloads.

SiteCatalyst is very good at web site metrics, though, and they
provide a lot of flexibility in tying those metrics to campaigns you
can define. Just don't think that if your interest is primarily in
document downloads that you will get a very complete picture through a
tool like this.

Hope this is useful :-)

Lee Romero

On Jan 15, 2008 9:00 PM, <TPangakis@...> wrote:

Hi all,

Kate and I have been exchanging e-mail about Omniture SiteCatalyst for
traffic monitoring of access points. To summarize: Adding some JavaScript
to web pages (assuming a license with Omniture, of course), enables the
sending of user data to a comprehensive data warehouse. Through path
analysis, you can determine WHAT users choose and, applying skills and
experience - you (the knowledge analyst) can theorize WHY they chose it and
WHERE the gaps are, for a particular subset.

Consider: http://www.omniture.com
And: http://jordy.gundy.org/omniture-success-kit/


Tara Pangakis, PMP to HP
Systems Documentation, Inc.
(978) 821-5038


Bernadette Boas <bernadette.boas@...>
 

Very interesting and definitely warrants a review. Thanks

Bernadette Boas


To: sikmleaders@...
From: TPangakis@...
Date: Tue, 15 Jan 2008 21:00:06 -0500
Subject: Re: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits

Hi all,

Kate and I have been exchanging e-mail about Omniture SiteCatalyst for traffic monitoring of access points.  To summarize: Adding some JavaScript to web pages (assuming a license with Omniture, of course), enables the sending of user data to a comprehensive data warehouse.  Through path analysis, you can determine WHAT users choose and, applying skills and experience - you (the knowledge analyst) can theorize WHY they chose it and WHERE the gaps are, for a particular subset.

Consider:
http://www.omniture.com
And: http://jordy.gundy.org/omniture-success-kit/ 

Tara Pangakis
, PMP to HP
Systems Documentation, Inc.
(978) 821-5038

-----Original Message-----
From: Valdis Krebs com>
To: sikmleaders@yahoogroups.com
Sent: Wed, 9 Jan 2008 7:01 pm
Subject: Re: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits

This is starting to sound like "The Social Life of Documents" -- who
used what to create what-else for who-else?

Re-use is a vote of value for the document and the person/people who
created it.

Valdis Krebs
http://www.orgnet.com
http://www.networkweaving.com/blog


On Jan 9, 2008, at 6:10 PM, Bernadette Boas wrote:

> John,
> a question
> I fully agree that the success stories and best practices that can
> be shared is a much more valuable way to measure the value the
> investment is making to the business. And that hits, visits,
> searches, etc. do not tell you that; though they at least ensure
> adoption and usage.
> However, I have also had many people wanting to understand 'reuse'
> of the documents made available, not to necessarily justify the
> direct KM investment, but to ensure that the tangible IP knowledge
> that is being provided (shared, stored, etc.) is of value; therefore
> assuming it is being used to improve the business. That said,
> unfortunately 'downloads' does not guarantee that the things being
> downloaded are of true value of quality, completeness, etc... And
> ratings and feedback are often viewed as subjective.
>
> Have you found any effective means of measuring true 'reuse'?
>
> Bernadette Boas
>
> bernadette.boas@hotmail.com
>
> To: sikmleaders@yahoogroups.com
> From: john.mcquary@fluor.com
> Date: Wed, 9 Jan 2008 21:55:47 +0000
> Subject: [sikmleaders] Re: Does anyone have tool for cleaning
> reporting documentum (doc mgt system) hits and downloads?
>
> Kate,
>
> I would encourage you to look for additional methods to demonstarte
> the value of knowledge sharing and collaboration. We do have
> extensive usage statistics, but concentrating on them diminshes the
> value of people-to-people connections. The usage metrics also tend
> to drive to a cost savings perspective rather than a value generation
> view.
>
> We use our usage metrics to demonstrate the level of activity in the
> tool, and use success stories to convey the value being generated.
>
> Regards,
> John McQuary
> Vice President
> Knowledge Management and Technology Strategies
>
> Fluor Corporation
> One Fluor Daniel Drive
> Sugar Land, TX 77478-3899
>
> 281-263-2533 (w)
> 281-263-2101 (f)
>
> --- In sikmleaders@yahoogroups.com, "Pugh, Katrina"
> ...> wrote:
> >
> > Hi, all -
> >
> > We need to report the ROI for our entire knowledge management
> system. At
> > present, the tools of collaboration and document management are
> loosely
> > coupled. People will click through the web interface (which we can
> > track) but access "certified" knowledge in the document management
> > system.
> >
> > I would like to calculate the likely reuse value based on the
> number of
> > actual downloads (and search results) in Documentum, but the
> challenge
> > is that I'm hearing that "the tool was not made to do that type of
> > reporting." The developers say that this would require capturing and
> > storing the log file (very very big), and then writing code to do
> siphon
> > of our counts and metadata, and then generate reports off of it.
> >
> > That seems like unusually big expense for something that would seem
> to
> > me to be a very common problem among knowledge managers looking to
> > measure the impact of document management repositories. Has anyone
> seen
> > or built a tool to do this?
> >
> > Thanks
> >
> > Kate
> >
> >
> >
> > Katrina Pugh
> > VP, Knowledge Management
> > IT Center of Excellence
> > Fidelity Investments, Personal and Workplace Investing
> > 400 Puritan Way M3J
> > Marlborough, MA 01752
> > (O) 508 357 3236
> > (M) 781 258 0920
> > katrina.pugh@...
> > Email <mailto:katrina.pugh@...> Confidentiality Notice: The
> > information in this email and subsequent attachments may contain
> > confidential information that is intended solely for the attention
> and
> > use of the named addressee(s). This message or any part thereof
> must not
> > be disclosed, copied, distributed or retained by any person without
> > authorization from Fidelity Investments.
> >
>
>
>
> Watch “Cause Effect,” a show about real people making a real
> difference. Learn more




Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/sikmleaders/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/sikmleaders/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:sikmleaders-digest@yahoogroups.com
    mailto:sikmleaders-fullfeatured@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
    sikmleaders-unsubscribe@yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/


More new features than ever. Check out the new AOL Mail!




Make distant family not so distant with Windows Vista® + Windows Live™. Start now!


Tara Pangakis
 

Hi all,

Kate and I have been exchanging e-mail about Omniture SiteCatalyst for traffic monitoring of access points.  To summarize: Adding some JavaScript to web pages (assuming a license with Omniture, of course), enables the sending of user data to a comprehensive data warehouse.  Through path analysis, you can determine WHAT users choose and, applying skills and experience - you (the knowledge analyst) can theorize WHY they chose it and WHERE the gaps are, for a particular subset.

Consider:
http://www.omniture.com
And: http://jordy.gundy.org/omniture-success-kit/ 

Tara Pangakis, PMP to HP
Systems Documentation, Inc.
(978) 821-5038

-----Original Message-----
From: Valdis Krebs
To: sikmleaders@...
Sent: Wed, 9 Jan 2008 7:01 pm
Subject: Re: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits

This is starting to sound like "The Social Life of Documents" -- who
used what to create what-else for who-else?

Re-use is a vote of value for the document and the person/people who
created it.

Valdis Krebs
http://www.orgnet.com
http://www.networkweaving.com/blog


On Jan 9, 2008, at 6:10 PM, Bernadette Boas wrote:

> John,
> a question
> I fully agree that the success stories and best practices that can
> be shared is a much more valuable way to measure the value the
> investment is making to the business. And that hits, visits,
> searches, etc. do not tell you that; though they at least ensure
> adoption and usage.
> However, I have also had many people wanting to understand 'reuse'
> of the documents made available, not to necessarily justify the
> direct KM investment, but to ensure that the tangible IP knowledge
> that is being provided (shared, stored, etc.) is of value; therefore
> assuming it is being used to improve the business. That said,
> unfortunately 'downloads' does not guarantee that the things being
> downloaded are of true value of quality, completeness, etc... And
> ratings and feedback are often viewed as subjective.
>
> Have you found any effective means of measuring true 'reuse'?
>
> Bernadette Boas
>
> bernadette.boas@...
>
> To: sikmleaders@...
> From: john.mcquary@...
> Date: Wed, 9 Jan 2008 21:55:47 +0000
> Subject: [sikmleaders] Re: Does anyone have tool for cleaning
> reporting documentum (doc mgt system) hits and downloads?
>
> Kate,
>
> I would encourage you to look for additional methods to demonstarte
> the value of knowledge sharing and collaboration. We do have
> extensive usage statistics, but concentrating on them diminshes the
> value of people-to-people connections. The usage metrics also tend
> to drive to a cost savings perspective rather than a value generation
> view.
>
> We use our usage metrics to demonstrate the level of activity in the
> tool, and use success stories to convey the value being generated.
>
> Regards,
> John McQuary
> Vice President
> Knowledge Management and Technology Strategies
>
> Fluor Corporation
> One Fluor Daniel Drive
> Sugar Land, TX 77478-3899
>
> 281-263-2533 (w)
> 281-263-2101 (f)
>
> --- In sikmleaders@..., "Pugh, Katrina"
>  wrote:
> >
> > Hi, all -
> >
> > We need to report the ROI for our entire knowledge management
> system. At
> > present, the tools of collaboration and document management are
> loosely
> > coupled. People will click through the web interface (which we can
> > track) but access "certified" knowledge in the document management
> > system.
> >
> > I would like to calculate the likely reuse value based on the
> number of
> > actual downloads (and search results) in Documentum, but the
> challenge
> > is that I'm hearing that "the tool was not made to do that type of
> > reporting." The developers say that this would require capturing and
> > storing the log file (very very big), and then writing code to do
> siphon
> > of our counts and metadata, and then generate reports off of it.
> >
> > That seems like unusually big expense for something that would seem
> to
> > me to be a very common problem among knowledge managers looking to
> > measure the impact of document management repositories. Has anyone
> seen
> > or built a tool to do this?
> >
> > Thanks
> >
> > Kate
> >
> >
> >
> > Katrina Pugh
> > VP, Knowledge Management
> > IT Center of Excellence
> > Fidelity Investments, Personal and Workplace Investing
> > 400 Puritan Way M3J
> > Marlborough, MA 01752
> > (O) 508 357 3236
> > (M) 781 258 0920
> > katrina.pugh@...
> > Email <mailto:katrina.pugh@...> Confidentiality Notice: The
> > information in this email and subsequent attachments may contain
> > confidential information that is intended solely for the attention
> and
> > use of the named addressee(s). This message or any part thereof
> must not
> > be disclosed, copied, distributed or retained by any person without
> > authorization from Fidelity Investments.
> >
>
>
>
> Watch “Cause Effect,” a show about real people making a real
> difference. Learn more




Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/sikmleaders/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/sikmleaders/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:sikmleaders-digest@...
    mailto:sikmleaders-fullfeatured@...

<*> To unsubscribe from this group, send an email to:
    sikmleaders-unsubscribe@...

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/


More new features than ever. Check out the new AOL Mail!


Bernadette Boas <bernadette.boas@...>
 

Thank you John, great input

Bernadette Boas
678-438-1908
bernadette.boas@...



To: sikmleaders@...
From: john.mcquary@...
Date: Fri, 11 Jan 2008 14:22:24 +0000
Subject: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits

Bernadette,

If you want to measure use (or reuse), then usage statistics will
suffice. If you want to measure value, then I think you have to look
elsewhere.

As Kate's developers pointed out, the statistics do take up space.
In our case, the storage space of our usage statistics is roughly
equal to the storage space of our content.

As far as usage metrics go, we can glean/interpret a lot of
information. Here are some examples from our system. Through the
first 10 days of January, 36.3% of our almost 25,000 members have
logged into the system at least once. Another 21.3% logged in in
December, and 10% in November. Having 67.6% of the users access the
system at least once in the last three months indicates a pretty good
level of overall usefulness.

We typically have about 400 documents downloaded daily. Of these,
about 100 documents are downloaded by one person getting one
document. The next 100 are one person getting 2 or 3 documents. I
take this measurement to indicate that users can get into the system
find what they need, download it, and get back to work.

We know by knowledge object / document how often it has been
downloaded, and by whom. Every user can see these statistics. Every
piece of content also has a review date set with notifications. Part
of the review process can include reviewing statistics for the
document. We can also run reports on the top read or downloaded
objects as well as the bottom.

We have many other statistical reports that can help measure use,
reuse, or usability, but these are independent of value measurement.

Hope this helps,
John McQuary
Vice President
Knowledge Management and Technology Strategies

Fluor Corporation
One Fluor Daniel Drive
Sugar Land, TX 77478-3899

281-263-2533 (w)
281-263-2101 (f)

--- In sikmleaders@yahoogroups.com, Bernadette Boas
boas@...> wrote:
>
> John,
> a question
> I fully agree that the success stories and best practices that can
be shared is a much more valuable way to measure the value the
investment is making to the business. And that hits, visits,
searches, etc. do not tell you that; though they at least ensure
adoption and usage.
> However, I have also had many people wanting to understand 'reuse'
of the documents made available, not to necessarily justify the
direct KM investment, but to ensure that the tangible IP knowledge
that is being provided (shared, stored, etc.) is of value; therefore
assuming it is being used to improve the business. That said,
unfortunately 'downloads' does not guarantee that the things being
downloaded are of true value of quality, completeness, etc... And
ratings and feedback are often viewed as subjective.
>
> Have you found any effective means of measuring true 'reuse'?
>
> Bernadette Boasbernadette.boas@...
>
>
> To: sikmleaders@...: john.mcquary@...: Wed, 9 Jan 2008 21:55:47
+0000Subject: [sikmleaders] Re: Does anyone have tool for cleaning
reporting documentum (doc mgt system) hits and downloads?
>
>
>
>
> Kate,I would encourage you to look for additional methods to
demonstarte the value of knowledge sharing and collaboration. We do
have extensive usage statistics, but concentrating on them diminshes
the value of people-to-people connections. The usage metrics also
tend to drive to a cost savings perspective rather than a value
generation view.We use our usage metrics to demonstrate the level of
activity in the tool, and use success stories to convey the value
being generated.Regards,John McQuaryVice President Knowledge
Management and Technology StrategiesFluor CorporationOne Fluor Daniel
DriveSugar Land, TX 77478-3899281-263-2533 (w)281-263-2101 (f)--- In
sikmleaders@yahoogroups.com, "Pugh, Katrina" > wrote:>>
Hi, all -> > We need to report the ROI for our entire knowledge
management system. At> present, the tools of collaboration and
document management are loosely> coupled. People will click through
the web interface (which we can> track) but access "certified"
knowledge in the document management> system. > > I would like to
calculate the likely reuse value based on the number of> actual
downloads (and search results) in Documentum, but the challenge> is
that I'm hearing that "the tool was not made to do that type of>
reporting." The developers say that this would require capturing and>
storing the log file (very very big), and then writing code to do
siphon> of our counts and metadata, and then generate reports off of
it. > > That seems like unusually big expense for something that
would seem to> me to be a very common problem among knowledge
managers looking to> measure the impact of document management
repositories. Has anyone seen> or built a tool to do this? > >
Thanks> > Kate> > > > Katrina Pugh> VP, Knowledge Management> IT
Center of Excellence> Fidelity Investments, Personal and Workplace
Investing> 400 Puritan Way M3J> Marlborough, MA 01752> (O) 508 357
3236> (M) 781 258 0920> katrina.pugh@> Email pugh@>
Confidentiality Notice: The> information in this email and subsequent
attachments may contain> confidential information that is intended
solely for the attention and> use of the named addressee(s). This
message or any part thereof must not> be disclosed, copied,
distributed or retained by any person without> authorization from
Fidelity Investments.>
>
>
>
>
>
>
> __________________________________________________________
> Watch "Cause Effect," a show about real people making a real
difference.
> http://im.live.com/Messenger/IM/MTV/?source=text_watchcause
>




Put your friends on the big screen with Windows Vista® + Windows Live™. Start now!


john_mcquary <john.mcquary@...>
 

Bernadette,

If you want to measure use (or reuse), then usage statistics will
suffice. If you want to measure value, then I think you have to look
elsewhere.

As Kate's developers pointed out, the statistics do take up space.
In our case, the storage space of our usage statistics is roughly
equal to the storage space of our content.

As far as usage metrics go, we can glean/interpret a lot of
information. Here are some examples from our system. Through the
first 10 days of January, 36.3% of our almost 25,000 members have
logged into the system at least once. Another 21.3% logged in in
December, and 10% in November. Having 67.6% of the users access the
system at least once in the last three months indicates a pretty good
level of overall usefulness.

We typically have about 400 documents downloaded daily. Of these,
about 100 documents are downloaded by one person getting one
document. The next 100 are one person getting 2 or 3 documents. I
take this measurement to indicate that users can get into the system
find what they need, download it, and get back to work.

We know by knowledge object / document how often it has been
downloaded, and by whom. Every user can see these statistics. Every
piece of content also has a review date set with notifications. Part
of the review process can include reviewing statistics for the
document. We can also run reports on the top read or downloaded
objects as well as the bottom.

We have many other statistical reports that can help measure use,
reuse, or usability, but these are independent of value measurement.

Hope this helps,
John McQuary
Vice President
Knowledge Management and Technology Strategies

Fluor Corporation
One Fluor Daniel Drive
Sugar Land, TX 77478-3899

281-263-2533 (w)
281-263-2101 (f)

--- In sikmleaders@..., Bernadette Boas
<bernadette.boas@...> wrote:

John,
a question
I fully agree that the success stories and best practices that can
be shared is a much more valuable way to measure the value the
investment is making to the business. And that hits, visits,
searches, etc. do not tell you that; though they at least ensure
adoption and usage.
However, I have also had many people wanting to understand 'reuse'
of the documents made available, not to necessarily justify the
direct KM investment, but to ensure that the tangible IP knowledge
that is being provided (shared, stored, etc.) is of value; therefore
assuming it is being used to improve the business. That said,
unfortunately 'downloads' does not guarantee that the things being
downloaded are of true value of quality, completeness, etc... And
ratings and feedback are often viewed as subjective.

Have you found any effective means of measuring true 'reuse'?

Bernadette Boasbernadette.boas@...


To: sikmleaders@...: john.mcquary@...: Wed, 9 Jan 2008 21:55:47
+0000Subject: [sikmleaders] Re: Does anyone have tool for cleaning
reporting documentum (doc mgt system) hits and downloads?




Kate,I would encourage you to look for additional methods to
demonstarte the value of knowledge sharing and collaboration. We do
have extensive usage statistics, but concentrating on them diminshes
the value of people-to-people connections. The usage metrics also
tend to drive to a cost savings perspective rather than a value
generation view.We use our usage metrics to demonstrate the level of
activity in the tool, and use success stories to convey the value
being generated.Regards,John McQuaryVice President Knowledge
Management and Technology StrategiesFluor CorporationOne Fluor Daniel
DriveSugar Land, TX 77478-3899281-263-2533 (w)281-263-2101 (f)--- In
sikmleaders@..., "Pugh, Katrina" <katrina.pugh@> wrote:>>
Hi, all -> > We need to report the ROI for our entire knowledge
management system. At> present, the tools of collaboration and
document management are loosely> coupled. People will click through
the web interface (which we can> track) but access "certified"
knowledge in the document management> system. > > I would like to
calculate the likely reuse value based on the number of> actual
downloads (and search results) in Documentum, but the challenge> is
that I'm hearing that "the tool was not made to do that type of>
reporting." The developers say that this would require capturing and>
storing the log file (very very big), and then writing code to do
siphon> of our counts and metadata, and then generate reports off of
it. > > That seems like unusually big expense for something that
would seem to> me to be a very common problem among knowledge
managers looking to> measure the impact of document management
repositories. Has anyone seen> or built a tool to do this? > >
Thanks> > Kate> > > > Katrina Pugh> VP, Knowledge Management> IT
Center of Excellence> Fidelity Investments, Personal and Workplace
Investing> 400 Puritan Way M3J> Marlborough, MA 01752> (O) 508 357
3236> (M) 781 258 0920> katrina.pugh@> Email <mailto:katrina.pugh@>
Confidentiality Notice: The> information in this email and subsequent
attachments may contain> confidential information that is intended
solely for the attention and> use of the named addressee(s). This
message or any part thereof must not> be disclosed, copied,
distributed or retained by any person without> authorization from
Fidelity Investments.>






_________________________________________________________________
Watch "Cause Effect," a show about real people making a real
difference.
http://im.live.com/Messenger/IM/MTV/?source=text_watchcause


Pugh, Katrina <katrina.pugh@...>
 

John –

I completely agree.  Absolutely, we are tracking both quantitative and qualitative measures (and rich success stories).  We’re even preparing to use the concept from Stan Garfield of having reuse stories submitted monthly and “Stars” awards.  

 

The concern here is getting this part of the “quantitative” side.  We’re learning about the constraints of usage metrics in Documentum.

 

Kate

 

Katrina Pugh
VP, Knowledge Management
IT Center of Excellence
Fidelity Investments, Personal and Workplace Investing
400 Puritan Way M3J
Marlborough, MA 01752
(O) 508 357 3236
(M) 781 258 0920
katrina.pugh@...
Email
Confidentiality Notice: The information in this email and subsequent attachments may contain confidential information that is intended solely for the attention and use of the named addressee(s). This message or any part thereof must not be disclosed, copied, distributed or retained by any person without authorization from Fidelity Investments.


From: sikmleaders@... [mailto:sikmleaders@...] On Behalf Of john_mcquary
Sent: Wednesday, January 09, 2008 4:56 PM
To: sikmleaders@...
Subject: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads?

 

Kate,

I would encourage you to look for additional methods to demonstarte
the value of knowledge sharing and collaboration. We do have
extensive usage statistics, but concentrating on them diminshes the
value of people-to-people connections. The usage metrics also tend
to drive to a cost savings perspective rather than a value generation
view.

We use our usage metrics to demonstrate the level of activity in the
tool, and use success stories to convey the value being generated.

Regards,
John McQuary
Vice President
Knowledge Management and Technology Strategies

Fluor Corporation
One Fluor Daniel Drive
Sugar Land, TX 77478-3899

281-263-2533 (w)
281-263-2101 (f)

--- In sikmleaders@yahoogroups.com, "Pugh, Katrina"
...> wrote:
>
> Hi, all -
>
> We need to report the ROI for our entire knowledge management
system. At
> present, the tools of collaboration and document management are
loosely
> coupled. People will click through the web interface (which we can
> track) but access "certified" knowledge in the document management
> system.
>
> I would like to calculate the likely reuse value based on the
number of
> actual downloads (and search results) in Documentum, but the
challenge
> is that I'm hearing that "the tool was not made to do that type of
> reporting." The developers say that this would require capturing and
> storing the log file (very very big), and then writing code to do
siphon
> of our counts and metadata, and then generate reports off of it.
>
> That seems like unusually big expense for something that would seem
to
> me to be a very common problem among knowledge managers looking to
> measure the impact of document management repositories. Has anyone
seen
> or built a tool to do this?
>
> Thanks
>
> Kate
>
>
>
> Katrina Pugh
> VP, Knowledge Management
> IT Center of Excellence
> Fidelity Investments, Personal and Workplace Investing
> 400 Puritan Way M3J
> Marlborough, MA 01752
> (O) 508 357 3236
> (M) 781 258 0920
> katrina.pugh@...
> Email pugh@...> Confidentiality Notice: The
> information in this email and subsequent attachments may contain
> confidential information that is intended solely for the attention
and
> use of the named addressee(s). This message or any part thereof
must not
> be disclosed, copied, distributed or retained by any person without
> authorization from Fidelity Investments.
>


Valdis Krebs <valdis@...>
 

This is starting to sound like "The Social Life of Documents" -- who
used what to create what-else for who-else?

Re-use is a vote of value for the document and the person/people who
created it.

Valdis Krebs
http://www.orgnet.com
http://www.networkweaving.com/blog

On Jan 9, 2008, at 6:10 PM, Bernadette Boas wrote:

John,
a question
I fully agree that the success stories and best practices that can
be shared is a much more valuable way to measure the value the
investment is making to the business. And that hits, visits,
searches, etc. do not tell you that; though they at least ensure
adoption and usage.
However, I have also had many people wanting to understand 'reuse'
of the documents made available, not to necessarily justify the
direct KM investment, but to ensure that the tangible IP knowledge
that is being provided (shared, stored, etc.) is of value; therefore
assuming it is being used to improve the business. That said,
unfortunately 'downloads' does not guarantee that the things being
downloaded are of true value of quality, completeness, etc... And
ratings and feedback are often viewed as subjective.

Have you found any effective means of measuring true 'reuse'?

Bernadette Boas

bernadette.boas@...

To: sikmleaders@...
From: john.mcquary@...
Date: Wed, 9 Jan 2008 21:55:47 +0000
Subject: [sikmleaders] Re: Does anyone have tool for cleaning
reporting documentum (doc mgt system) hits and downloads?

Kate,

I would encourage you to look for additional methods to demonstarte
the value of knowledge sharing and collaboration. We do have
extensive usage statistics, but concentrating on them diminshes the
value of people-to-people connections. The usage metrics also tend
to drive to a cost savings perspective rather than a value generation
view.

We use our usage metrics to demonstrate the level of activity in the
tool, and use success stories to convey the value being generated.

Regards,
John McQuary
Vice President
Knowledge Management and Technology Strategies

Fluor Corporation
One Fluor Daniel Drive
Sugar Land, TX 77478-3899

281-263-2533 (w)
281-263-2101 (f)

--- In sikmleaders@..., "Pugh, Katrina"
<katrina.pugh@...> wrote:

Hi, all -

We need to report the ROI for our entire knowledge management
system. At
present, the tools of collaboration and document management are
loosely
coupled. People will click through the web interface (which we can
track) but access "certified" knowledge in the document management
system.

I would like to calculate the likely reuse value based on the
number of
actual downloads (and search results) in Documentum, but the
challenge
is that I'm hearing that "the tool was not made to do that type of
reporting." The developers say that this would require capturing and
storing the log file (very very big), and then writing code to do
siphon
of our counts and metadata, and then generate reports off of it.

That seems like unusually big expense for something that would seem
to
me to be a very common problem among knowledge managers looking to
measure the impact of document management repositories. Has anyone
seen
or built a tool to do this?

Thanks

Kate



Katrina Pugh
VP, Knowledge Management
IT Center of Excellence
Fidelity Investments, Personal and Workplace Investing
400 Puritan Way M3J
Marlborough, MA 01752
(O) 508 357 3236
(M) 781 258 0920
katrina.pugh@...
Email <mailto:katrina.pugh@...> Confidentiality Notice: The
information in this email and subsequent attachments may contain
confidential information that is intended solely for the attention
and
use of the named addressee(s). This message or any part thereof
must not
be disclosed, copied, distributed or retained by any person without
authorization from Fidelity Investments.


Watch “Cause Effect,” a show about real people making a real
difference. Learn more


Bernadette Boas <bernadette.boas@...>
 

John,
a question
I fully agree that the success stories and best practices that can be shared is a much more valuable way to measure the value the investment is making to the business. And that hits, visits, searches, etc. do not tell you that; though they at least ensure adoption and usage.
However, I have also had many people wanting to understand 'reuse' of the documents made available, not to necessarily justify the direct KM investment, but to ensure that the tangible IP knowledge that is being provided (shared, stored, etc.) is of value; therefore assuming it is being used to improve the business. That said, unfortunately 'downloads' does not guarantee that the things being downloaded are of true value of quality, completeness, etc... And ratings and feedback are often viewed as subjective.
 
Have you found any effective means of measuring true 'reuse'?
 
Bernadette Boas

bernadette.boas@...


To: sikmleaders@...
From: john.mcquary@...
Date: Wed, 9 Jan 2008 21:55:47 +0000
Subject: [sikmleaders] Re: Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads?

Kate,

I would encourage you to look for additional methods to demonstarte
the value of knowledge sharing and collaboration. We do have
extensive usage statistics, but concentrating on them diminshes the
value of people-to-people connections. The usage metrics also tend
to drive to a cost savings perspective rather than a value generation
view.

We use our usage metrics to demonstrate the level of activity in the
tool, and use success stories to convey the value being generated.

Regards,
John McQuary
Vice President
Knowledge Management and Technology Strategies

Fluor Corporation
One Fluor Daniel Drive
Sugar Land, TX 77478-3899

281-263-2533 (w)
281-263-2101 (f)

--- In sikmleaders@yahoogroups.com, "Pugh, Katrina"
...> wrote:
>
> Hi, all -
>
> We need to report the ROI for our entire knowledge management
system. At
> present, the tools of collaboration and document management are
loosely
> coupled. People will click through the web interface (which we can
> track) but access "certified" knowledge in the document management
> system.
>
> I would like to calculate the likely reuse value based on the
number of
> actual downloads (and search results) in Documentum, but the
challenge
> is that I'm hearing that "the tool was not made to do that type of
> reporting." The developers say that this would require capturing and
> storing the log file (very very big), and then writing code to do
siphon
> of our counts and metadata, and then generate reports off of it.
>
> That seems like unusually big expense for something that would seem
to
> me to be a very common problem among knowledge managers looking to
> measure the impact of document management repositories. Has anyone
seen
> or built a tool to do this?
>
> Thanks
>
> Kate
>
>
>
> Katrina Pugh
> VP, Knowledge Management
> IT Center of Excellence
> Fidelity Investments, Personal and Workplace Investing
> 400 Puritan Way M3J
> Marlborough, MA 01752
> (O) 508 357 3236
> (M) 781 258 0920
> katrina.pugh@...
> Email pugh@...> Confidentiality Notice: The
> information in this email and subsequent attachments may contain
> confidential information that is intended solely for the attention
and
> use of the named addressee(s). This message or any part thereof
must not
> be disclosed, copied, distributed or retained by any person without
> authorization from Fidelity Investments.
>




Watch “Cause Effect,” a show about real people making a real difference. Learn more


john_mcquary <john.mcquary@...>
 

Kate,

I would encourage you to look for additional methods to demonstarte
the value of knowledge sharing and collaboration. We do have
extensive usage statistics, but concentrating on them diminshes the
value of people-to-people connections. The usage metrics also tend
to drive to a cost savings perspective rather than a value generation
view.

We use our usage metrics to demonstrate the level of activity in the
tool, and use success stories to convey the value being generated.

Regards,
John McQuary
Vice President
Knowledge Management and Technology Strategies

Fluor Corporation
One Fluor Daniel Drive
Sugar Land, TX 77478-3899

281-263-2533 (w)
281-263-2101 (f)

--- In sikmleaders@..., "Pugh, Katrina"
<katrina.pugh@...> wrote:

Hi, all -

We need to report the ROI for our entire knowledge management
system. At
present, the tools of collaboration and document management are
loosely
coupled. People will click through the web interface (which we can
track) but access "certified" knowledge in the document management
system.

I would like to calculate the likely reuse value based on the
number of
actual downloads (and search results) in Documentum, but the
challenge
is that I'm hearing that "the tool was not made to do that type of
reporting." The developers say that this would require capturing and
storing the log file (very very big), and then writing code to do
siphon
of our counts and metadata, and then generate reports off of it.

That seems like unusually big expense for something that would seem
to
me to be a very common problem among knowledge managers looking to
measure the impact of document management repositories. Has anyone
seen
or built a tool to do this?

Thanks

Kate



Katrina Pugh
VP, Knowledge Management
IT Center of Excellence
Fidelity Investments, Personal and Workplace Investing
400 Puritan Way M3J
Marlborough, MA 01752
(O) 508 357 3236
(M) 781 258 0920
katrina.pugh@...
Email <mailto:katrina.pugh@...> Confidentiality Notice: The
information in this email and subsequent attachments may contain
confidential information that is intended solely for the attention
and
use of the named addressee(s). This message or any part thereof
must not
be disclosed, copied, distributed or retained by any person without
authorization from Fidelity Investments.


Bernadette Boas <bernadette.boas@...>
 

Kate,
not sure of the tool you are using, but downloads, hits, visits, -0- search results, etc. should be common metrics captured by a content/km/document portal/repository application. It is unfortunate that yours does not provide it
 
Measuring actual 'reuse' of downloaded tools is often not available, since it is believed that once a user downloads to their desktop the application loses linkage to the asset (unless you are using check in/out). But again customizing proprietary means of measuring inference of reuse should also be available.
 
You would have to measure the cost of reporting to the value of the information toward usage - which is critical.
 
Linda Hummel could provide you additional detail around this as well.
 


Bernadette Boas
bernadette.boas@...




To: sikmleaders@...
From: katrina.pugh@...
Date: Wed, 9 Jan 2008 16:15:51 -0500
Subject: [sikmleaders] Does anyone have tool for cleaning reporting documentum (doc mgt system) hits and downloads?

Hi, all –

We need to report the ROI for our entire knowledge management system. At present, the tools of collaboration and document management are loosely coupled. People will click through the web interface (which we can track) but access "certified" knowledge in the document management system.

I would like to calculate the likely reuse value based on the number of actual downloads (and search results) in Documentum, but the challenge is that I'm hearing that "the tool was not made to do that type of reporting." The developers say that this would require capturing and storing the log file (very very big), and then writing code to do siphon of our counts and metadata, and then generate reports off of it.

That seems like unusually big expense for something that would seem to me to be a very common problem among knowledge managers looking to measure the impact of document management repositories. Has anyone seen or built a tool to do this?

Thanks

Kate

 

Katrina Pugh
VP, Knowledge Management
IT Center of Excellence
Fidelity Investments, Personal and Workplace Investing
400 Puritan Way M3J
Marlborough, MA 01752
(O) 508 357 3236
(M) 781 258 0920
katrina.pugh@fmr.com
Email
Confidentiality Notice: The information in this email and subsequent attachments may contain confidential information that is intended solely for the attention and use of the named addressee(s). This message or any part thereof must not be disclosed, copied, distributed or retained by any person without authorization from Fidelity Investments.

 




Get the power of Windows + Web with the new Windows Live. Get it now!


Pugh, Katrina <katrina.pugh@...>
 

Hi, all –

We need to report the ROI for our entire knowledge management system. At present, the tools of collaboration and document management are loosely coupled. People will click through the web interface (which we can track) but access "certified" knowledge in the document management system.

I would like to calculate the likely reuse value based on the number of actual downloads (and search results) in Documentum, but the challenge is that I'm hearing that "the tool was not made to do that type of reporting." The developers say that this would require capturing and storing the log file (very very big), and then writing code to do siphon of our counts and metadata, and then generate reports off of it.

That seems like unusually big expense for something that would seem to me to be a very common problem among knowledge managers looking to measure the impact of document management repositories. Has anyone seen or built a tool to do this?

Thanks

Kate

 

Katrina Pugh
VP, Knowledge Management
IT Center of Excellence
Fidelity Investments, Personal and Workplace Investing
400 Puritan Way M3J
Marlborough, MA 01752
(O) 508 357 3236
(M) 781 258 0920
katrina.pugh@...
Email
Confidentiality Notice: The information in this email and subsequent attachments may contain confidential information that is intended solely for the attention and use of the named addressee(s). This message or any part thereof must not be disclosed, copied, distributed or retained by any person without authorization from Fidelity Investments.