welcome everybody thanks for joining this morning to our webinar strategic portfolio management benchmarks learn how to implement SPM benchmarks to improve your business value metrics so we're about three after uh let's go ahead and get started um so I'm Scott Wallace um Chris is online with me here also and we have a few other experts in the background to help answer q a so let's go ahead and get started so uh first thing I want to mention here is a little oops sorry little housekeeping um so during this session we have q a and we have chat we prefer if you would to put your questions in Q a because we have some experts online with us that can answer those questions in Q a um if not at the very end we also might be able to take some questions at the very end during the open kind of open q a and prefer not to put them in chat um so if you would use q a um the session's being recorded it will be shared in community and will also be shared in a webinar series and including of course the the presentation of PowerPoint presentation here too will be uploaded to that um after the session if you would there's a short survey we always love to have you take the short survey it gives us really good feedback on how you liked it how the how the presentation went and also for us just always how to improve so that would be appreciated at the very end if you would take a survey um so as with all presentations um externally facing you know we need to make note of our Safe Harbor statement so this presentation may contain forward-looking statements that are based on beliefs and assumptions and an information currently available to us as of the day of this presentation so in short you know we may be talking about a few things that are on our roadmap that aren't necessarily in product yet okay so thank you um the next section here I just want to do a quick introduction so I've been mentioned I'm Scott Wallace I'm part of the product success organization um strategic portfolio management product success based out of Georgia uh been working on servicenow for many years um Chris Canela is the product manager the product owner product manager of this terrific application um he got his strategic portfolio Management in the product management organization based out of Texas both Chris and I have spent many years working with many servicenow customers um helping them adopt helping them grow helping them learn collecting their requirements getting feedback as Kush will mention a little later there's ways we collect feedback from customers it's very important in terms of how we build product so both Chris and I in different different roles in different companies I've been doing this for a long time so with that um thank you for joining today I'll hand it off to uh Chris thank you Scott [Music] so I want to go ahead and do one thing which is turn off the remote control so thank you Scott for that uh the agenda is very straightforward and for signing into the agenda so we're going to have a survey three survey questions to get a uh idea from you what your thoughts are on benchmarks and we are personally doing that before we have a little section on what are benchmarks because uh sometimes not everyone is totally clear on what benchmarks are then there will be a brief discussion around how to get benchmarks enabled whether it is for SPM which is the portion of benchmarks that I work on where I work on the different kpis and I work with clients to determine what the best kpis are or whether it's uh you know enabling benchmarks as a core product and avenob is the product manager for that and then they're a demonstration so that we can step through how you would use benchmarks it is extremely straightforward because as we go through the discussion you'll see there's not you know once benchmarks are set up it really is self self-contained self-running it really does just take care of itself and so the demonstration will be extremely straightforward a few leading practices based on some wonderful lessons learned that Adam has had because as I said he speaks to clients who use benchmarks for all reasons whereas I tend to focus just on benchmarks for SPM and then some great slides that Scott has put together around resources that will help you get started or videos that are online that you can watch so that you can move forward so hopefully we're going to ask this you know the purpose of the session today as you can see is to help you understand what things how SPM benchmarks will work and you know moving all the way through to make sure that you would feel comfortable discussing with your stakeholders and end users how they would be able to use and the value that they would get out of spin benchmarks and at the end of course we'll ask you know do you feel that we met this please be uh honest uh you know it's uh I I of course always love to hear wonderful things but I also need to hear just like benchmarks I need to hear where I could do better or again like benchmarks where I could do better compared to somebody else so please uh please do feel free to be honest okay the surveys so first question is just a very high level just to get a feeling because there are several thousand customers who have enabled benchmarks but uh servicenow has many thousands of customers so just to get a uh idea of where we're at as a rule with the group just find out how how familiar are you with servicenow benchmarks not just SPM so how long do you typically leave for the uh questions to to be answered oh just look at the um generally the number of people responding could probably remember people attending it looks like we'll get about half or a little over half so I don't know 75 is always ideal all right yeah 100 would be great right Chris good metric good Benchmark no plun intended well I think I think we're at 29 I think we need just one more person to hit that magical 75 we don't get there in the next few seconds we'll just press on and and uh I'll I'll speak to it so it it looks like we have a very good mix of people who are mostly unfamiliar with benchmarks it's you know we're we're hitting it eighty percent on the first two points where we have uh you know most of the people on the call today are either not familiar with benchmarks which is good because this isn't more of a primer session or investigating benchmarks but no plans do you play at this time again perfect group for this because uh hopefully we can give you a reason to want to deploy and then a uh that's good we have a small percentage three percent who do who have investigated and are playing to deploy and uh this is great 17 of you already have one or more Benchmark sets uh deployed so for you this is going to be I guess uh I guess I can uh you you can on snooze until we get to the part about the demo because everything else you know if you've got them deployed everything leading up to the demo I think is going to be old hat for you so okay that's great though so we're at we're at uh 70 17 already have benchmarks but really 80 percent are either not familiar or no plans at this time so I think we've got a fantastic mix okay the next is again maybe you know exactly what our benchmarks do maybe you don't going in blind what impact do you feel that the uh benchmarks capability could have on your organization let's see if we can hit that 75 again we just came in under the line on the last one so yeah thanks for everyone who's participating too this is this is uh nice for us to see and this question is uh part of why I appreciate your time on this question I know that you you're probably saying well there's obviously some interest otherwise it wouldn't be on the call but this just gives us an idea really of of where we're at and whether or not uh abanov and I need to spend maybe a little bit more time promoting the value of benchmarks because they are not immediately familiar to everybody so again always appreciate the time okay so it looks like we have a nice even mix here um and Scott you usually click on share results I'm happy to do that I just don't know sorry Chris yeah thank you yeah so uh again no impact not an act act oh that's a hard word active topic so you know we're hitting right at 17 that's great uh I appreciate you taking the time it's something that maybe you know everyone's it sounds to me like uh maybe you're not quite sure of what this can do for you so for the for the no and low impact definitely appreciate that and appreciate you taking the time to uh a rock to come in given you your your starting position is that it's it's low impact and you know for the uh to the medium impact and the significant impact I I am of the opinion I'm so you know selfishly that yes I think it is medium to significant impact and uh the reason reason why is I guess it's one of those things when when you're a uh whether whether you're a child on the playground or you're watching you know professional sports or watching you know captains of industry you know they say if you want to if you want to be the best you've got a beat the best and so you know I I think that that is you know from a medium or significant impact I think that is what we can use benchmarks to do and now this next question I'm definitely Keen to see your answer here this is a question that we have asked a few times over the uh the three quarters leading up to when we released SPM benchmarks after benchmarks core product had been released and again obviously right now this is something that we're going to use to help guide and then form our direction as we add new new kpis I will say it now because it's important for you to hear but I'll probably say it again later on as you see these kpis they are not especially hard for us to add once we know uh talk with customers and we know okay here are some new benchmarks that you would like to have to compare yourself against other people getting the benchmarks in and having them added are is something that that is uh very you know low effort high value and it's something that we can do but we just want to make sure that we're continued to focus on where people want us to be so and I it looks I guess Scott you're sharing the results no here I'll show them okay they're being sure so this is interesting I I will say when we ran this poll with the same question to the larger SPM pack last year and then when we ran it uh internally with partners and SCS and with our indoor park support as far as what they thought customers would most appreciate the Strategic kpis hit uh in in those polls hit consistently in the 75 to 80 range with alignment and execution each taking about 10 percent so this is uh interesting that there are we have a nice mix and and we have at least one person to convert so no interest at this time I appreciate you coming to the call so let's see if we uh now I feel like we should ask this question Scott again at the end and see if we've uh converted that one person over so that there is some interest we'll try that thanks all righty so what are benchmarks and I'm for those of you who are on any of the dpps that I work with or you've done calls with me I'm very big on analogies so by way of example this is a you know this this is something that I thought made uh you know helped kind of drive it home for me as far as uh you know it's very easy to confuse you know kpis with benchmarks and so you know when I was uh yeah I would say when I was younger but even though I wasn't that young but you know several years ago I had a Fitbit watch and you know when they first came out and it was very trendy it was a lot of fun and I enjoyed having it count my steps but uh at one point I was talking to some co-workers and they were like you know we actually link all of our fitbits together and then all of us who are traveling Consultants we can see how each other is doing at you know how we're all doing at the end of the week and we can see you know who's who's I guess you'd say winning for lack of a better term right and suddenly you know this Fitbit watch which was telling you how many steps I had per day was now telling me how many steps I had per day but compared to your peers here's how many steps you have a day and suddenly we were all trying to do better and yeah for no reason except that we were competitive we were all trying to I guess you could say when and so you know if if I could have had my Fitbit watch not just instead of just compare myself to the you know 10 or 12 immediate co-workers that we were looking at but if I could have said no I want to compare myself against specific types of people and in this case I said you know males over the age of 50 want to improve their cardio so I have self-identified as over the age of 50 I want to improve my cardio oh by the way I live in Central Texas where sometimes you know maybe I don't want to compare my my steps or my activities against all of America because right now it's 105 degrees outside maybe I want to compare only people you know who are in Central Texas or Central Austin in order to see how I'm doing you know that then I'm suddenly getting not just again my steps and again which is a great kpi here's how many you had yesterday here's how many you have today here's what you're doing but now I I have a way to start looking at this as okay here's how this particular peer group is doing and I can change what I you know again I'm self-identifying so I can change my peer groups suddenly I have a kpi along with a with a way to see if I'm really doing good and I'm really improving against the crowd and then you know obviously if my watch was also able to take a look at my lifestyle and say something like maybe you should bike to the grocery store which is less than a mile away instead of driving there that would be one way that you could improve your cardio activities right so some recommendations would be very helpful so that is that to me is the difference between a kpi or a dashboard where you're just looking at your numbers which again very helpful you always want to know whether or not you are improving but now you're able to look and say am I improving and how am I doing against others are others improving faster than I am so this is a general statement for all of our kpis whether it is for SPM or itsm or hype itom or or security so you know they they give you this visibility into you know I'm not going to read this you can reassess and I can talk but it's nice because it gives you visibility where you're able to see how am I doing what is my Trend and then like I said for that peer group where and your peer group can either be everybody who is a customer and is sharing their anonymized data you'll and that's the thing I'm trying to make it a point to use the word anonymized at least five times today so whether it is you know your data versus everyone else's anonymized data or whether it is you know your data versus other Industries or people of a similar size it's nice to see how am I doing am I getting better but am I getting better faster than everybody else similarly I know sometimes you know we we all want to always get better but sometimes you don't get better sometimes for whatever reason sometimes things go down and uh as as I one time had a had a broker explain to me yes you lost money but you lost less money than everybody else so sometimes you know even when you go down it's nice to know okay I went down but it seems like everybody else is going down and they're going down a little bit worse so maybe I'm not doing as bad as I thought I was so there you know there's there's definitely you know different ways to look at these numbers won't you know but you know how much better am I doing compared to everybody else but also if I am struggling are others struggling more or less than I am so and for those of you didn't see it on the other Slide the benchmarks that currently are in place again this session we're going to do the demo focused only on strategic portfolio management but the you know currently the benchmarks are for a number of areas itsm itom virtual agent security operations and success dashboard as well as strategic portfolio management and it does seem that this list grows you know every six months there's new groups when we launched in November uh strategic portfolio management was the third type of Benchmark that was available and you know now we're at six so you know just just in the uh two releases since note two store releases since November the number has doubled so where can you get the benchmarks uh portion of code so gizm benchmarks are in the store and you can get them there a very easy to download There's at the end as part of the reference there's a number of videos that uh both documentation and videos that will walk you through step by step the actions that you would need to take to get them downloaded and installed but the like I said the ESPN benchmarks are in the store and the core benchmarks those are platform and you would get those whenever you receive an instance or are Z booted and I believe and maybe I misunderstood abinov but I think that if you have item I Tom ipsm secops then they are you know again they're not turned on but it is installed and the capability is there the the uh kpis for uh benchmarks are sorry I'm sorry my screen on my other computer my I just got kicked out of my instance so I was like ah um they while it is installed it is not turned on so nothing is ever turned on without you being actively involved that's correct no Chris yeah thank you enough yeah um so who cares about benchmarks and I guess this is this is for the especially for those who are at the we're not really thinking about it we don't really know if it has interest the to me the the who wants it the every group who has benchmarks they all have their own sets of you know who cares the personas that are most interested in this for SPM those are split based off of who based off of the the traditional personas who are interested in SPM and the types of you know the types of uh kpis that he came up with were split into three types strategic alignment and delivery and for the Strategic kpis those are focused on the Strategic leaders and that's where you would find out questions you know again just like it says here they're going to look at this because they're trying to grow for the future and just like it you know it says especially with the uh yeah the gay economy being more and more of a thing and employees wanting you know having more and more control over their future this really are kpis that will help with on some level retention and so there are things like a few good examples would be how much am I spending on Innovative work versus run the company work and you know that there was a very interesting uh statistic that I heard years and years ago that said you know when companies self-identify and and and without looking at numbers and they go how Innovative are you they're like well you know we you know we're probably at the 40 to the 60 range we're highly Innovative but then when they looked quantitatively at numbers of you know the effort that was put into things or the money spent on things they found out that really that Innovation number and again this was you know 10 15 years ago last time I saw the stat the number was much lower it was it was more in the teens for a number of these companies and they were quite surprised once they you know once they went from what they thought to having the numbers Quantified and again if they had their numbers Quantified and compared to others suddenly you know you not only have a Direction but you have something that you can use as a lever to again attract that best and brightest of the uh of the uh world to come work for you for the agile transformation leader those uh metrics tend to be just like it says alignment they're much they're much more focused on for the work that we're doing how well Associated and how well aligned is it to the Strategic goals of the company or if we have for example a agile initiative how much time and effort are we really spending on that agile initiative compared to time and money spent on uh you know more traditional either waterfall or hybrid activities so you know we we have you know it's it's a it's definitely that that middle layer that the kpis seem to be much more focused but again they you know they are uh you know trying to trying to make sure in that level between the delivery and the executive you know how how well lined up are things really and then on the delivery side you know that that is much more you know I've been a project manager and so you know not not necessarily individual project managers but managers of project managers you know they you know they're going to be much more interested to find out you know at you know not just are we doing things aligned to the mission of becoming more agile for that for that agile transformation leader but for example how much effort are you know what you know what what do we have as far as you know the average number average size of our scrum teams or are we really you know if if we feel like we're doing good within with actual uh how many you know we we know are we keeping track of how many percentage of points that we start versus finish but how are we doing compared to other companies so it's it again the data on the delivery side definitely ties into that agile piece but it is much more granular and it's focused around those areas we'll go over the case guys that we have right now and like I said those those kpis are always growing so why did we build benchmarks just like I I've said it and it's you know a bit redundant it was you know uh focused on providing that visibility and you know just hey since you're provide the visibility key indicators but really uh you know it's so that you can not just have the visibility at a glance to see where you're going but really it's how am I doing and how am I doing against others you know so you can so you can really track that Trend and you can see there's a breakdown for the comparison you know just like right now the comparison is based off of industry region size or everybody and then one option is industry and size so it's industry region size industry and size for everyone and that is something that over time we expect to mature right one thing that some have raised as a potential and again I'm not going to speak for avenov but uh you know because I'm not going to speak to the road map for the core product but you know potentially one thing that has been brought up is market cap right especially if we're looking at SPM uh metrics then market cap might be a good indicator as opposed to um you know license count or you know typical typical size so a quick uh set of considerations and there is a but you know there's a summary slide towards the end the key groups that are here like it says leadership portfolio managers I personally don't see project managers or you know scrum team leads being interested in the stats they're going to be focused on their particular stats compared to other project managers at the company or within their division they're not going to be looking as a rule outside to see how they're doing against other companies so this is more of a leadership or portfolio manager activity the licensing is very straightforward it's standard and you know uh there are some things that even though it's standard there are some kpis for example in the SPM benchmarks that really even though you might be able to see The Benchmark and turn them on they won't have a lot of meaning for you such as information about ethics because you can only access epics if you have a pro license now I'm going to cover this a little bit more uh actually it's the next column but we'll cover more a little bit later that cake guys can be manually adjusted so if for example you have a definition of what you considered an epic to be and it's different than our formula for what an epic is you can modify the formula for that kpi and your numbers will still go into the bucket of how for example if there was something to to use a simple example outside of SPM if it was uh how you know average time to resolve critical support tickets if your definition of critical is any support ticket that's flagged as that has a has a flag set to critical okay that's probably in our formula but then if you have a further modification of that formula where you're saying no that also means if the CEO of the company is called you know regardless of the flag on it if the CEO of the company is identified as the creator of the ticket then that's also considered critical right so you could modify that formula so that you know you can change the definition of of what is critical or the definition of what is capital spend or what is an epic or what is the definition of run versus grow as long as once you've changed that definition you're willing to share that data back to everyone else they won't know that you change the definition but we're assuming that it it resonates with you you'll be able to have that number compared to everyone else and and what they consider for example the spend on run versus grow um SPM benchmarks this should I should clarify this SPM benchmarks are compatible with Tokyo and forward bench marks the core capability those were released I believe in San Diego and so you know there is more uh compatibility that's available with with the core benchmarks functionality okay so again the benchmarks kpi it's based on industry size industry size region you can compare them against your cohorts the data is compared monthly so even though my early example I used uh you know daily and I was talking about steps or weekly and I'm talking about exercise on this level it really is a monthly comparison that we use and that is the level of granularity but still I think that's that's a perfectly perfectly good value and then the dashboard I'll be showing this it's got this you know the widget view you're able to see the trend you either see your numbers or you can click and it's up to you like it is in that upper left and and see that more split out as a uh you know bar chart the numbers when we build the formulas to try to keep things nice and simple green is good red is bad and it's you know very straightforward as far as tracking your trends the analysis this would be if you click and dive in deeper you would be able to see that number compared you click on your individual kpis see the trend and just like I've said probably a dozen times already it's anonymized against your cohorts your cohort's data is anonymized which means that your data is anonymized and you know you're able to see that information against them one thing I do want to call out I know that it's in a slide later on but one question that I do get asked every once in a while is well can I still use benchmarks if I don't want to share my data and the answer is no so you know that that is that is the uh give if you want to get and so if you want to be able to compare your numbers and see what your percentage of work focused on grow versus innovate is within your company and have that compared to other com other other people you have to be willing to share your data so that it becomes part of that industry average um so the uh just a general slide right here you get everything in a single dashboard you can split between the different types of uh kpis and you are able to you know it's it's easy opt-in with with a click you select the kpis that you want to use and you know it's only the kpis that you've said you want to see are the kpis where you're sharing the data back and it's something where I've told people a few times even if you don't think that you are planning to use this right away there's absolutely nothing wrong with sharing the data right I've had a few people say well I don't want to share my data because we're not good well that's okay you know if you don't want to look at the benchmarks or if you don't think that you're good it might still be helpful to other people so they can find out maybe maybe you are good and or or maybe or maybe you aren't good and that's still going to be informative for other people and and because no kpi is shared uh and you there's no uh information on the cohort unless we have a minimum of 20 people who are involved if you are the first person to activate a new kpi there will be no chart for you because there's you know in theory it would only be your data and it's not until we get to that magic number of 21 that suddenly these charts are available and we do that to make sure again that there is no way to know that your data is skewing the numbers and we do try to build out our formulas so that uh we don't have a situation where a very you know a very large client we we specifically craft the formula so that a single large client can't skew the numbers and you know we try to get it so it is again more of that average but it's it's the same with the splits on the cohorts you can't have a split by region for example even if you've got 50 people if all 50 people are in the same region or except for five people and you know it's 50 people in one region five in another there will not be a split by region because you or there won't be a split for the one region because there's only five people in it so we do definitely go out of our way to make sure that your data is protected on the last point with Improvement recommendations the many of the kpis that have been around longer they do have uh Improvement recommendations the SPM kpis we have not added recommendations yet we are going to add them over time we want to see where people's are most interested and where their focus is so that we can spend most of our time looking into those areas for the recommendations so for now it is a comparison and you would make the call but uh it would be over time we're going to be adding in those recommendations okay real fast on the enablement of benchmarks very straightforward the opt-in is required like I said it is important a consideration is not just you know technically can I do it with the opt-in but do you have that business involvement do you have stakeholder support because you don't want to surprise people by being opted in without them knowing about it and so you know we we uh we do want to make sure that you do that like I said we've worked very hard to use standard definitions for kpis you can change them we support that and once you opt in there are six months of global data that is available for opting in if it's available the corresponding data for your instance will be included you would just need to run that historical job and so even when you you know if you decide today to to opt in and start using kpis as long as the system is set and you run that historical job we would look back six months for you and then if the industry data is there you would be able to get that Trend right off the bat you would you don't have to wait six months to get that Trend analysis data okay the this is a bit technical but the long and short is we have two types of users who are impacted by SPM benchmarks the admin who turns on and opts in and sets up the benchmarks and the end users who are able to see the various kpis and that's really all we have two types of users it is very straightforward so I'm going to begin the login process since I as I mentioned it threw me for a second there when I got kicked out so as a end user it is very straightforward to get to the benchmarks dashboard you just go all benchmarks you go to the dashboard pretend I clicked here it will go ahead and open up this page and I would see the you know benchmarks for the various uh types that I have enabled and so you know here's some of the itsm ones I've only enabled itsm itom and SPM you can see all the you know at a glance we start with default of all the kpis that we've turned on will be enabled by default but if you want to only look at specific kpis you can get that view and like it says like like we said earlier you can do a comparison and I don't think we have self-selected our industry in this instance so it's just based off number of users but if we had flagged ourselves as being part of say Healthcare then we could also do a comparison against other Healthcare companies or other uh security companies whatever whatever that industry happens to be the data at a glance is again extremely straightforward how are you doing red or blue uh you know shows your number and your trend what is the industry average and then what percentile does that put you in and so by the way these numbers you might look at these and go wait a minute how can I be in the 15th you know how can I be in it at 15 the industry average at 24 that's still the 94 percentile well that's because we're using candida so you know some of these numbers are not uh you know we because again this is something else that I will call out you can't have benchmarks turned on in anything other than production because we know that people do interesting things in their Dev environments they have odd data or stale data so you can only have benchmarks available in production and because this is our candida it is not connected to the real benchmarks uh set of data right we we don't want to take a chance that our test data messes at the average so in view your individual Trend across that six month history assuming that you've either loaded up the history or you've been using the system for more than six months and then you are able to uh come over and you can click right on one of these numbers and see what your trend is and this this is that example that I said where you could see you know if I'm if I'm going you know up or down how is you know I may be going down but is the industry going down faster or if I'm going up is the industry going up slower and in this case you can see you know we are outperform we we have traditionally outperformed industry however we're on a dip the industry's on a dip but we're dipping a little bit faster so maybe there's something here that we need to uh take a look at and pay attention to and so you know that's that again is is part of that another thing if you wonder again most of the kpis for SPM are very you know the definition is in the description however if you're not sure what percentage of London Business for the last 12 months means you can click on the definition we provide this is text only we provide the textual plain language definition of how the we are doing the calculation but again if you modify the formula then it might be a good idea it's an admin to go ahead and say what the new formula is and what's driving it so you know this could say you know if you've modified this it could be these sum of actual costment on projects demands and uh you know and work that bill has requested right regardless of what type of work it is or who it's for anything like that all of that is considered uh you know money spent you know as as part of uh you know that that Innovative thing and so you know you can change the formula but you can also change the description and it's textual you can even put in you know again more friendly language or something that's unique to your company it's very straightforward uh let's see another option that you have is to download a report here's a sample that I did so you've got you know just a quick based off of the uh SPM kpis you can see a quick and quick at a glance View and then you can go through each kpi if you wanted to and see how those numbers are going right now this is not integrated with the status report but it is something that we would like to have integrated to the status report and something that you know you could on your own pull into the status report thank you so real fast going over to the setup and let's pick up this again so you can see once you've opted in again we want to make this very easy I want to I want to say it again the data is anonymous you don't need to worry that someone's going to look at this and know this data came from servicenow or this data came from uh you know Chris canela's you know Crisco uh it's not you no one's going to know where it came from but if for whatever reason you decide after opting in you don't want to participate anymore we make it very easy for you to opt out right this isn't uh this isn't one of those situations where you know I'm sure you've seen you know that the government is trying to help make it easier to get out of programs that you don't want to be in we're never going to fall under that umbrella right we make it very easy put it right up front if you want out you can get out quite simply if you do not want to be involved in a specific kpi it's as hard as a single click and then as I mentioned if you want to change the definition of that kpi then then it is very simple automate here we go so you can click and you can see our description of it that we provide you're able to change that you can see what the formula is and then if you want to change what that formula is it just uses various filters and so you're able to change the filters modify them and you know you can decide what you know what logic you want for any kpi and you know we did try to for the first since we've only done one release kpis for SPM we did try to keep the formulas extremely simple but uh they are always there and available for you to change if you want probably should have from the slide before I jumped into the demonstration this is what I'm going to be showing you okay so a few leading practices and evanov and I were talking about this last night and you know from these best practices you're probably seeing again the importance of historical data and the freedom to modify formulas I hope you saw from the from the very brief demo once kpis are set up and turned on there's really you know it's not like there's no data entry activities from end user there's no uh configuration that an end user needs to go through they they literally once you as an admin or once you've had your admin turn it on they just need to go click on it and it's there and it's available and so from a maintenance perspective or or from a you know problems pain points faced from end users there's really nothing tricky about this it's it's extremely straightforward and so the big thing that that comes up is when you turn on or opt-in to the kpis go ahead and run the job to collect the historical data it specifically says 180 days not six months even though the data is split out by month uh the historical data is held for 180 days so it's you know six months give or take a day um one lesson learned that tends to happen is when people modify the formulas make sure you know even though you can't change it make sure that you validate those formulas in the hub uh one example that here or one notional story that Ivanov has somebody modified their formula but they but they used while trying to determine the number of critical events instead of taking total events less non-critical events their logic was the total number of critical events minus all events and so they ended up with a very interesting negative number that had nothing to do with critical events because those were one of the first ones that they removed and the end users found it especially confusing because the description had a very different description of what the purpose was of the kpi so in the event you do modify these kpis make sure that you've spoken to the business that they want the kpi changed and that they agree with the logic and the formula that you're about to use and then after you've made the change go ahead and validate it and make sure that it is uh proper before you move forward okay so some q a and some resources hopefully uh we have achieved what we're trying to get at here and you understand the value of benchmarks you've got a good idea of how to deploy them maybe not a great idea but you see the next few slides and you understand how to communicate you know that value to your end users so with that in mind Scott did you want to speak briefly about the Evangelist program yeah yeah I'll take that so um as as always we would love to hear from our customers right and customers like to share and so there's a program called customer SPM evangelist and there's different ways to to contribute and participate and I'll leave this up on the screen here just for a second you could should hopefully if you got your phone out you can bring your phone up and click on the QR code there and it'll take you right to um a form if you want to submit to the form say hey I'd like to become part of the program and again there's many types of um events that you can participate in um anything from a very simple collaboration event to knowledge events to things like that but we'd like to get you in the program so if you're interested and it isn't just about benchmarking of course this is an overall total evangelist program so it helps us it helps you we collaborate so it's a great thing to participate in and we always encourage you if you can uh to participate in and again different types of levels as you can see your contribute discuss engage promote you know share in different types of events so thanks Chris yep and next up this is a slide that has been pulled together based off of different things mostly things put together not by me so there are some tremendous videos that you will find in you know that are very short bite size videos that go over uh again if you're not sure what is the value of benchmarks you can watch that bite-sized video you can watch you know you can promote it to others if you think there's value but they're not quite sure uh to me probably the best video here it is the longest video but it's this one and this takes you to an event from February of last year but this is a very in-depth session that covers sort of Benchmark Soup To Nuts it's not focused just on SPM benchmarks but it covers pretty much everything that you would want to know about you know whether it's the value as to the business or some of the technical needs that you may have it's definitely right there most of the other videos are um excuse me they are different and they are you know unique with unique talkers and unique screens that they tend to cover portions of this much longer benchmarks Academy presentation so all of these uh videos and all the docs are good but if you're looking for a single and you happen to have an hour free time the benchmarks Academy is probably the most in-depth video that you will find the rest of them are are fantastic much more bite-sized and they will point you in a good direction especially if you're trying to convince someone of the value Chris um I loaded all these books Mark bookmarks into chat so in chat you'll see each one of the links of course it'll be in the PDF and so forth but it's in chat if you're interested yeah so that's thank you Scott that that should be very helpful and then you know again when you're asked the question hopefully you are comfortable with what are benchmarks the key Concepts and where to find the supporting resources if not please reach out to us and let us know um you know it's very self-serving for me but I I would love to get everybody using benchmarks so you know certainly if you have questions and uh I don't have the answers I I'm very good at finding the people who do have answers and the last slide here is uh around would you like to be able to you know would you like to participate uh either have a one-on-one conversation to learn more about it again self-serving I would love to do that but also if you would like to be participate if you would like to be a participant in the design partner program for SPM benchmarks where we would look at what new kpis we should add or as part of the core benchmarks group with abanov so you can look at you know help around the future of the product then please reach out to us let us know we'd love to have you we are very big on you know not living within our our crystal Castle but you know active feedback and and working with customers and clients and doing product Discovery so I would like to invite you to give us your feedback one on one and either you know feedback one-on-one or feedback as part of a larger group Chris would you like me to share your email address and chat sure yeah of course okay sorry as Chad never occurred to me yeah just put that in there um and I think from what we're looking at the Q a here we have one open question um our office typing in one uh one answer here with the one that's remained open for a little bit because I don't think we really know the answer yet is does Benchmark work with Team spaces I don't know if we really know the answer to that yet we'll have to investigate that oh Scott I'm gonna I'm gonna stop talking turn it over and say thank you very much everybody I appreciate your time and giving giving me an hour of your day today yes thank you everybody really appreciate it and look for them you know after this is completed you'll get a short survey we'd love for you to take the survey and of course is always look for future events uh future webinars on different topics within SPM again thank you for attending