From time to time, I run across a vendor who says:<\/p>\n
We have over 40 years of combined experience…<\/strong><\/p><\/blockquote>\n
What does that really mean?<\/p>\n
The intended meaning is that, if there are 4 people in the room, they each have about 10 years of experience.<\/p>\n
But, it could also mean that one of them\u00a0has 39 years of experience, and the other three\u00a0have been in the business for only 4 months!<\/p>\n
Further, let’s say that this particular vendor is an AI (Artificial Intelligence) consultant – why would I want 40-year-old advice from the mid 1970’s, when the largest computers of that era didn’t have as much computing power as my smart phone?<\/p>\n
<\/p>\n
Senseless vs. Meaningful Calculations<\/h2>\n
Essentially, we have a set of scalars that are supposed to represent the respective sizes of each individual’s experience base within the group.<\/p>\n
Let’s say we have 4 people:<\/p>\n
\n
- Timmy:\u00a0 12 years of AI experience<\/li>\n
- Stacy:\u00a0 15 years of AI experience<\/li>\n
- Johnny:\u00a0 8 years of AI experience<\/li>\n
- Alice:\u00a0 10 years of AI experience<\/li>\n<\/ul>\n
This gives us a set of 4 scalars:\u00a0 {12, 15, 8, 10}<\/p>\n
Although there are many valid<\/strong> ways to compare and combine these numbers, there are also very many ways to combine them, that don’t make sense.<\/p>\n
At the end of the meeting, Stacy proudly proclaims, “we have 45 years of combined experience<\/strong>“, because she added all of these scalars, but what does that really mean?<\/p>\n
It’s not like the team are simply ONE person who becomes eminently more qualified with combined magnitude.\u00a0 Take the case of our most junior member – in theory, if we give Johnny another year of experience, he still sits within the footprints of all three of his other team members.\u00a0 The team’s range of experience is really based on it’s most senior member (Stacy).<\/p>\n
It’s not like there is some kind of historical significance, as if getting to some magic number of combined experience qualifies the team for an historical marker.\u00a0 If they make it to 100 years of combined experience, they can’t proclaim “experience since 1917!”.<\/p>\n
Talking about a set of numbers that each represents a constant value is just like combining height:\u00a0 Unless you plan to have them stand on each others’ shoulders, or make them lay on the ground end-to-end, the “combined height” would be completely pointless.\u00a0 The statement, “we have 22 feet of consultants visiting us today…” just doesn’t make any sense.\u00a0 Nor would it make sense to say, “it took 600 pounds of consultants to fix this problem”.<\/p>\n
Instead, if we understand that we have a set of 4 people, and each scalar in the set represents ONE of the four people, we can come up with some meaningful metrics<\/strong> by comparing<\/strong> rather than combining:<\/p>\n
\n
- The team has an average of 11 years of experience (indicating a consistent qualitative aspect to the work product)<\/li>\n
- The team has an experience base of 15 years (perhaps the senior team member has hands-on experience with older, but still practical technologies that are only taught in textbooks today)<\/li>\n
- Everyone here has between 8 and 15 years of experience\u00a0 (Even the most junior member has a solid experience base, and practical knowledge)<\/li>\n<\/ul>\n
Likewise, if we’re talking about numbers that reflect a rate, such as salary or billable rate, it might make sense to say, we had four consultants come in for a meeting.\u00a0 Their combined billable rate was $800\/hr, and the meeting lasted two hours, so the cost of the meeting was $1,600.<\/p>\n
<\/p>\n
Conclusion<\/h2>\n
When you use math to compare or combine a set of numbers, ultimately, you have to maintain perspective about what those numbers really mean<\/strong>.<\/p>\n
If you combine numbers in ways that don’t make sense, you might create a meaningless metric<\/strong>.<\/p>\n
<\/p>\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
Meaningless Metrics – Combined Experience From time to time, I run across a vendor who says: We have over 40 years of combined experience… What does that really mean? The intended meaning is that, if there are 4 people in the room, they each have about 10 years of experience. But, it could also mean […]<\/p>\n","protected":false},"author":16,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"aside","meta":{"footnotes":""},"categories":[17,20],"tags":[],"class_list":["post-4110","post","type-post","status-publish","format-aside","hentry","category-good-design-bad-design","category-science","post_format-post-format-aside"],"_links":{"self":[{"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/posts\/4110","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/comments?post=4110"}],"version-history":[{"count":7,"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/posts\/4110\/revisions"}],"predecessor-version":[{"id":4118,"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/posts\/4110\/revisions\/4118"}],"wp:attachment":[{"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/media?parent=4110"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/categories?post=4110"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/justinparrtech.com\/JustinParr-Tech\/wp-json\/wp\/v2\/tags?post=4110"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}