okay good morning good afternoon good evening uh welcome to platform analytics academy thank you to everyone that has joined um we have another great one on tap uh today so real quickly uh i just want to go through a couple logistical things um if you've been here before you probably heard it but if you have not uh just listen in definitely because uh certain things may affect you so um the first thing i want to do is help you understand that what we do here is for you so we try to bring fresh ideas and better understanding and practical guidance to um everything that we can inside of platform analytics um inside of servicenow itself so hopefully you'll get something out of this and any of the previous ones that we have as well this is being recorded uh for a few reasons one we're going to definitely put it out in the community attached to this event and then we're also going to have it out on youtube on a couple of the youtube channels that we have um if recording is an issue with your company uh then you may want to go ahead and drop now because this definitely will be recorded and we will have q a so please use the q a um box within zoom if you can for all questions uh try not to put them in chat we do have uh a couple of people that are on uh dan kane who is also on my team he'll be here to answer questions along with myself why the presentation is going if they are questions that we can answer during the presentation we will do that if they are relevant to where the presenter is at we will stop the presenter and ask him that question there if they're unrelated to the topic because you're allowed to ask those types of questions as well we'll get to those or get to as many of those as we can towards the end of the session so again my name is thomas davis and i'm an outbound product manager on the platform analytics team and today our presenter is uh abner and i hope that i didn't mess that up uh but he is a senior product manager with our itsm um bu team so uh he is gonna bring us great information about uh benchmarks and the power of them we have had quite a few questions in the community for a while around uh benchmarks and we have done our best along with commun other community members to answer those questions so this is going to be a great resource that we'll have going forward uh to give us great information uh about benchmarks so uh it is an intro into them um we may later on uh actually do a deeper dive we have uh talked about that i'm levi and i so look for that as well but for now we'll just do um an intro into benchmark so uh allah if you want to take over you can start sharing thank you thomas and hello everyone good morning good good afternoon good evening and welcome to a session an introductory session on benchmarks so i would quickly introduce ourselves um me and muthu over here are our part of idsm benchmark team and we will we both would go a few of the few capabilities that you would see with benchmark and run through a demo and try to answer any questions that you have so in today's session we would cover the following agenda items that would give us an insight into what is benchmark and how you can use it at your organization so now a brief background of the product so for any organization when we try to bring about any change to the business process or the product itself we generally bank on the insights that we can extract from all the data that ha that are handy to us also while the iit leaders and process owners analyze and evaluate their stance using the organization specific metric we also saw them looking for data points on a how is their organization doing in comparison to others and b what are the some recommended ways that they can bring in the change that they want at their organization and with benchmark you get both the capabilities and in fact much more so let's quickly go through few of the product attributes and how can you benefit from benchmark as a product so first of all you can opt into benchmark with just a single click it's an easy opt-in process that we have we have multiple kpis under itsm item and secops and in fact you can choose which kpis would you like to participate in and get the benchmark scores for now we generally tend to associate benchmark as a prescriptive system but benchmark also lets you to customize and configure the kpis you opted in for and that would depend depending upon your business process and usage at your organization now once all these are set in the background you are all ready to come all ready to compare your organization's performance against your peers now you can compare either based on industry segments we have fueled um we have few industry segments that we already associate each accounts to we have you can compare against the region of your operations and lastly you can also compare yourself to the organization of the similar size now finally as we were talking about what how what are the ways that the organization can bring in the change actually you can drive continuous service excellence by utilizing and implementing the improvement recommendations that we have as part of benchmark now here are a few snapshots of our dashboard and the recommendation details that we have on our product so for our next section we'll quickly go into a demo so to start with uh let me tell you one thing on for which all customers would benchmark be available to so any customers with an itsm and item subscription would have benchmarks available to them and it is available with id um standard skew now once you go into the opt-in process you would be just given a few backgrounds on uh what kind of data would be captured what kind of data utilization would be there and once you read through this this opt-in agreement you can choose to opt-in for the product itself now once you check this you can opt into the product and you are all set so now once you opt into the product itself now the next steps would be to start using the dash and the benchmark application itself but before you use it there are a few jobs that generally helps us in collecting the data day over day and so for example we have benchmark data collection which actually collects the data points for each of and every kpis on a daily basis and this would be for these sections like ips and secop kpis we have a specific job for item related kpis now along with this we all now we know that once you start using it you would like to see what your historical data look like as well right so we have a on-demand job that you can run once you opt-in for the product and you can we have a lead time of six months that this collection jobs collect the data from and you can choose to execute this particular job now what it does is once you hit on execute it'll try and go in and look at all the the kpis that are active and would start collecting data for you so this is pretty much it for you to get started and started with benchmark and start leveraging the dashboard itself now over here for example we have the different sections that you can compare your uh kpis against and you would have few details like for which month is it uh is the data for which industry do you belong and then we have the sub sections in each of these beams for example for itsm we have incident problem change and request now you can compare yourself on the basis of industry the number of users base and of course the region that we saw with this dashboard you'd also be able to download the report into a pdf format so that it's easily shareable across your org now there are two types of scores that you would be seeing the ones in green are where your bench you are above the benchmark scores but the ones in red is where the improvement needs to happen now this is a scope for a particular month but what you can do is you can click on the card and you would be showing the details on how you are performing month over month on the as compared to the benchmark scores so you would be able to see your scores as well as the percentile rank now this is a kpi where an improvement is needed so we provide few recommendations that we have out of box which you can track and you can get started with the implementation if you are using continual improvement management system from itsm you can track it end-to-end from benchmark to cim as us application or you can take this recommendation out of servicenow realm and track it manually as well now the other part that we have here is related to the definition of the kpi now this just gives them high level in info on what the kpi looks like and what is the formula in the background that that gets considered for this particular kpi hey so a question came in and it said can the trends be filtered by assignment group out of the box or we have to modify it so it can be so currently we do not have so assignment group and the service providers at a particular organization can be different from one or to another so what we have is a cumulative level at an org uh starter level so let's say if uh if you want to utilize pa at the uh at your company to have a granular uh granular uh what you say um the split of these or slicing of these data points you can do it at your end but the comparison would be happening at the prescriptive level which is at the odd level itself does that answer the question or yeah i mean if if if andrea has more questions she'll she'll type back in yes she said yes it does thanks for that um and then one other one real quick to move on has benchmarks always been an opt-in for customers it has been yes okay good um here's another one uh how can organizations remain anonymous but still benefit from the offerings of benchmarks and i'm guessing being uh anonymous with with other companies since you're sharing that data so one of the items that we would be covering in in later stages is the data points or the data that we capture is always anonymized and is always at an aggregate level so whatever data we capture from company a is not available or not would not be able to be seen by any of the other customers who have opted in and secondly why we are on this particular point um we also do not capture any personal person identifiable information or even customer identifiable information okay great there is another question that came in but i think that you actually may get to some of this in your demo so i'll let you go and go forward so next we'll quickly go over the kpis that are part of benchmark as of today and this is an information that you would also be able to uh find in our dock site first that is available for the product so for idsm we have 20 kpis and they are split in their respective areas of incident problem change service catalog knowledge base and there are a few other kpis like csat scores and number of fulfill requests for fulfiller which we have considered as others category now along with this we also have nine more kpis related to ci health and when vulnerable items that you can leverage and opt-in for item and secops area now we'll for the next part of our uh sorry for the next part of our session we'll quickly go through a quick demo on how you can you um opt into a particular kpi customize it depending upon your need and things like that so once you opted in for the product right um you can come to the same setup section of the benchmarks and now what you would see instead of a product opt-in you would get the list of kpis that are available now these are all the kpis that are available out of box and you can choose whether you would like to participate or not and by toggling it on and off you can toggle it on on or off and save the details now apart from this you would also have a capability to configure these kpis now one of the kpi that we would look at is um percentage of high priority incidents right so let's say you want to participate in this kpi and now this kpi is internally built off of two contributing indicators one is number of high priority incidents and number of incidents resolved now we know that the me may be number of incidents resolved would be same for all across all our customer base but high priority incidents bring in brings in that subjectiveness right that a particular organization might have a different definition as against the other so over here out of the box we have said that priority is less than or is critical now let's say at your organization the high priority item is any incident with a lower priority than what is high so you can come over here choose that particular condition select that and say update now once you update it this kpi is now reflected or would be updated as per what your definition is right so once this is safe you are set from a kpi perspective now another thing to take care of why we are why we customize it so we looked at the the historical data collection job so once you have updated your system we would recommend you to execute or run this again so that the kpis now are reflected depending upon the changed uh condition now after doing all this stuff like opting in for product setting up your kpis participating for the kpis you are all done so once uh you are done from a setup aspect what we do is we will try uh each month we will collect this data will collect uh all the kpi information from each of the customers we will run um we will try to exclude any outliers in the system and we'll we will try we will come up or we will arrive at a benchmark schools now this benchmark scores would then be published back to each of you who have opted it so on a high level this is how an end-to-end setup for a benchmark looks like and things that you would be able to do with benchmark as a product so um thomas are there any questions before we move on oh some have been answered while you've been going on um there was there was one and i know that you had mentioned it was going to be in there there was someone that asked how many customers actually participate in benchmarks but you may be getting getting to that and that's what i told them so for now i think we're good well let me see here another one came in so let's see if we update the condition of our kpi collection how do we wait a minute this may not be related let's see yeah just how many customers have signed up for benchmarks so currently we have around 2 650 customers amongst 10 industry categories that is that servicenow supports okay great yeah and you can keep going thank you so now as one of our last segments for this session let's quickly take a look at few of the frequently asked questions that we get from our customers so um these questions might have been covered during our presentations but can act as a good summarization at the end of it right so the first question that we generally get to see is how this benchmark works and how to get started with benchmark so just like we saw in the demo there are five major steps that you need to take the first one being opt-in opting into the product second choose the kpis that you would like to participate in third customize those kpis if needed activate the jobs and of course run the historical data collection job at the end now few of the other questions that we get is around how and what data are pulled from the instance and as we covered in one of the questions it's only anonymized and aggregated aggregated data that we collect and none of the pii's or cis ciis are ever captured for benchmarking perspective and now once this data is collected we generally push or publish the benchmarks goes month over month on 11th of each month so let's say for the month of january the benchmark scores will be published on 11th of february which is in next two days so moving on so one of this particular product being data heavy we get a lot of questions around what is the security aspects that we have considered while building this product so in the background we use rest apis with authentication methods to create a secured communication channel between your instance and the central instance now what is the central instance that we that i'm referring to so this is the place where we actually store the data that we collect and this is this instance where we calculate or do the calculation the background calculation of arriving at the benchmark scores before we publish it out now who now one of the other concerns that we have frequently heard is now we are sharing data around um around what our metrics looks like so who all from servicenow can view the benchmark scores so we only have very limited access and authorized users only who can look at this data now the data that they are looking let me guarantee it again as it's anonymized we won't be able to um we would not be able to get information apart from what your score is and that's it so before we move on uh if there are any questions thomas we can pick them up yeah there's a couple that came in so um there was one and i actually thought it was related to something else but it's not so the question is um if we update the conditions of uh our kpi or benchmarks how do we make sure that we are not uh quote unquote cooking the books that is how do we make sure we're still collecting data that is comparable to our peers is there best practice and intent guidance just just making sure that what we're actually collecting and the way that we're collecting is comparable to the other customers that are doing the same thing is there guidance around that that's a very good question in fact so as i was referring earlier benchmark is a prescriptive kind of uh application now whichever kpis we ship out of the box we provide few guidelines of best practices on what is intended out of those kpi now the example that we took was specifically around high priority incidents now if you think for you um p3 or p2 is also a high priority that level of configurability and that level of customization is with you but the prescription would be that you choose only the related high uh priority incidents only and we have similar kinds of uh kpis around vulnerable vulnerable items ci items things like that so the prescriptiveness comes up across by the information that we provide with each kpis that is shipped out of the box hope that answers okay great yeah patrick can tell us uh that does answer so a couple other ones that are uh related to one another so uh hello we do not use itsm uh we use only the hr module are there are we able to utilize benchmarking for hr er modules and also very similar someone asked is there benchmarks for vulnerability response modules so we have uh so let's take the hr part first so integrating with hr for um for benchmarking is in our roadmap i would not be able to comment on the specific timelines but we are looking to expand our list of kpis and expand the offerings to other views as well now for vulnerable items uh vulnerable item response kpis we have only few around uh the secop ones let me just show you again so we have these around them now um if these are not the ones that you're looking for you can definitely reach out to us from benchmark teams and let us know which all of the other kpis that you want to get added as part of our out of box kpi guest okay great um another one is um would it be possible to generate a set of annual benchmarks i used the benchmarks as targets on my reports only change the target annually so a 2021 average would be better than december does that make sense it does it does so one of our items that we might be looking up uh are looking at in future releases is how how we can generate quarterly um quarter over quarter or ear ear uh reports on the end-to-end uh benchmark scores that we received over let's say the last fiscal year or things like that but right now it's only month over month um but we definitely have that as a as a idea that we are working towards okay great and then um can physical year be uh customized uh as in in the the demo while we were seeing the dashboard whether you would be able to choose any other month is that the question um we might maybe they they can respond to better uh help explain that our physical years from june to may is what he's saying he or she is saying can that be changed yeah so right now as it's month over month we uh fiscal year consideration is not in place but that's a very valid point and why we are defining our quarter over quarter versus your parameters we will definitely keep that in mind uh that's a very valid and a very good uh consideration that we you brought up and um i'm really if i'm saying that correct and if i'm not i apologize that that's probably a a good one for the ideal portal so if you go into the idea portal in the community um and look and see if one is already there or if not create one it will it would definitely get traction then so good question as a process we always uh take a look at idea porting the community ideas that we is generated and we take it back as a feedback for us to implement so um while you take this back session back with you you can definitely leverage idea portal to provide any feedback you have great always yeah and then one last follow-up on that and it says also anything on irm or grc uh right now the uh the first three [Music] views that we wanted to integrate with is itbmcsm and hr but definitely we want to integrate with as many as many product offerings that we have from servicenow and uh so that this particular product acts as a source of good from benchmark aspects okay great and then what has been the highest take up for benchmarking industry wise and i'm guessing that's meaning which one is used most often what is what are companies looking at uh to correlate between one another so if it's related to which kpis are mostly used um because as i said we have 2600 odd customers who have opted in for the product but few of the kpis um resonates more with them and for example the mttr which is um mean time to resolve or repair um because that's directly uh impacting the service quality at a at our at a customer's organization right so something on the sides of mttr some few things around uh what's the percentage of uh high priority items that also has a lot of traction from all our customer base and apart from it we also see them uh referring what the request up fulfiller kpi that we have because that gives an indication on what other customers are investing in from an automation versus manual handling perspective versus what um that particular customer is could that answers or that was an alignment to the question that was asked yeah and it says they're thinking like industry-wise eg you know example outsourcing etc like you know i guess do you know from an industry standpoint the ones that and maybe the mctr is the one that is but just from an industry standpoint are there ones that you know are more heavily used between um customers than than others and it sounds like you're saying that mttr is but um and has no name so anonymous that's what anonymous is asking okay so um what i just um talked about is from overall perspective but uh what we can do is we can take this back as something to run a transition numbers on on let's say for each of the industry segments which one makes more sense and uh definitely that's a good uh way to validate okay which are the kpis that we should be looking at because these are the companies which are comparable to me and are is similar to me and they are looking at these kpis so definitely uh we can take this back and i can try to have these numbers up with thomas maybe two weeks or three weeks down the line yeah and when you and when you have those then we can definitely attach them to the event we can we can put them directly into the event so it'll be there so great so a couple others came in so um is there a plan to allow uh customers to create custom benchmarks meaning could we build a benchmark off of an out of box formula as an example we may have multiple types of c-stat csat surveys and want to have a benchmark kpi for each individual survey we would use the out of the box parts to build the formula but configure each to calculate per each survey so basically is there is it in the pipeline to allow customers to create or customize uh what's out there um [Music] okay so right now to be very honest we don't have something like that in the plans uh just for one reason because let's say uh that's a capability of creating your own formula indicators and pa indicators now we would need to normalize it against all the customers who have opted in for benchmarks now to identify the the similarity between multiple kpis would become difficult for us to create that benchmark scores so right now we are not envisioning it in near future and but definitely if you can put that idea on our ideapoodle we have a track so that we get back to you with better uh response and better more data points around what is going to happen and what's not okay and susan if we if we missed a mark on what you were asking please just type back in um maybe you know to clear it up if if we missed a mark on that but yeah good so another one came in percentage of high priority incidents uses p1 p2 average time uses p0p1 very different impact on results so i don't know if that's a question or an explanation of something um you want to you want to go with that maybe maybe ed needs to get better a better um explanation of what he's asking here okay um so if okay ed i guess if this is a finding that you see that there's a disparity between two of our or two of our kpis we can take this back as an input and we can look at these kpis yeah because ideally what we call as high priority incidents in one kpi should be the same as what we call it for the next or the other game okay yeah he's saying it's a follow-up to an earlier question about the definitions of two benchmarks about high priority yeah and i believe that um yeah it looks like he's answering it okay good all right let's see so steven what stephen got here so um yeah you know what we could do that dan that's a good point let's let's take let's take ed off of mute and let him ask just to make sure that we can get him answered correctly where is he yet i think he was by last name there he is okay hey ed go ahead once you ask out loud so we can get a better understanding oh thanks this is a question i've been asking for a long time and i never seem to be able to get an answer that's one of the reasons i'm here today if you just open the there's two um benchmarks about high priority incidents the first one is percent of high priority incidents if you open it up and you look at the definition the definition states that it's on p1 and p2 incidents and then underneath that is is the average time to resolve a high priority incident and if you open up and look at that definition it says this is on p1s and p0 incidents and it doesn't make sense that the two things talking about high priority incidents define high priority incidents differently hope that helps yes ed that definitely helps and i guess there might be some mess at our end which we can take a look at because ideally as i i was explaining the high priority uh definition of high priority incidents would remain same across any of the kpis that is leveraging that uh agreed on that particular point right okay thank you because then it's your question it or at least well give us some guidance so maybe something to look at yeah i'd just like you to look at the two definitions and understand you know they should be the same a high priority incident on the percent of high priority incidents should be the same as how long it's taking to resolve those incidents it shouldn't be two different different should not be two different definitions of high priority okay correct and uh we'll take this back ed and we will try to analyze the situation hope that's okay okay all right okay thank you for bringing that up um we had another one that come in that said do you have any good success stories of implementing benchmarks benchmarking any good customer success or success story sorry uh i can't uh think of it right at the top of the mind but we have seen few comments on from our customer side saying yeah if we can leverage benchmark this would be a game changer for them to identify the opportunities and implement it but i know um those are some generic comments that we have seen and i would try and see if we can share that document out but uh there's a one slider that we have on what our customers are saying about benchmarks so hopefully that that would help you uh thank you yeah and and not to uh put dan or tara on blast but i know that that you've had extensive conversations with customers about many things are there any examples that either one of you could share are you are you talking in reference to how they leverage benchmarks yeah just using it i mean just talking to a customer about it and then starting to use it just things like that if you have any you know i i i can honestly rarely get much feedback after the fact and but i do have everybody um excited to join and asking how to make sure that they are part of that and um i i don't get much feedback after that so i'm assuming that's good right because once they get on board they're they're excited about uh being part of all of that and and measuring things compared to each other i know for a while there we had some um uh req this was this was when it first came out some requests to put uh the benchmark side by side um on a dashboard with their with their own instead of going out to the benchmark you know what i mean by itself kind of pulling it onto their dashboard and um i think we you know provided some solutions for that but i mean i i really rarely get any feedback which means that i think it's just they're excited they join and then i don't hear anything else after that like oh this isn't working or this isn't what i wanted it's usually like click and go yeah good point yeah awesome thank you tara pretty similar just that it's you know it's it's just that yeah just kind of anecdotally that day the the ones that i have talked to about it definitely enjoy it but it's nothing that i have like any kind of written up you know any kind of written up studies or anything like that that's a badario i'm sure our marketing folks would have some things but you know nothing off but nothing that's any kind of that there you know any customer would be formalized on okay and then mark your your follow-up would be good to track opportunities and outcomes once an organization has implemented um it's good to hear this on on this call and we definitely will take notice of what you're asking about and um you know even on on abnova's team with with them being the the product managers on it it's something good to take back to to make sure that and i think that he was even talking about that he has some information about you know customers that are using it and and the things that they're saying about it so yeah good point mark thank you good feedback in the chat too from joe thank you so uh i already already have at least one if at least you know maybe we should just unmute unmute joe i won't put you on blast like that joe but thanks for the feedback yeah so uh stephen has a question in some ways this is very reminiscent of the kpi library project from 2014 are there any plans to allow customers to crowdsource upvote share benchmarks um by the way and this is a caveat does servicenow still support kpi library uh but yeah is there is there any any talks about crowdsourcing up voting and sharing benchmarks across uh customers uh not across customers we don't have that yet um and uh on the second question whether servicenow still support kpi library i might need to take that back even so that we can get an answer to you on it oh my understanding is no we do not okay good okay um let me take sharing back over here real quick i i just hope that i'm not messing your name up that bad yeah it's cold for me yesterday but i've probably messed it up but let's see away from all right let me share my screen back here let's see we got another one here uh okay this is not directly related to well you know you have your useful resource so they can look at that while we talk about this um this question here so on data collection jobs we're starting to get the error fetch too many rows from indicator source is there a downside to increasing the mass records value to a high value like 30 million the intricate inch intricate intra gate man i can't i can't talk today jobs continually pull in new records into the module and expect to get up to 20 plus million records so um one i guess i would say and tara and dan please chime in here how often are you running this job how often is the data that it's pulling in getting updated and is have you done pretty much everything that you can from a uh filtering perspective to limit how much is coming into that uh and i think for me just thinking of that many records my question is how often are you doing it um danteron if you want to add anything to that i mean it that yeah it's not like i mean that's that doesn't push the envelope i mean that's a that's a lot of records but i mean i hope you're not doing that like yeah i would ask yeah i would ask that the frequency and do you have date ranges on your your jobs um because if you don't that's where you're going to hit that right um are you making sure that because generally i mean you can you can run the jobs and and it can parse through it no problem as long as it's you know looking for specific records based off of date ranges so if you have it open-ended your queries aren't aren't being stopped with any sort of date range then then that's where you're gonna that's usually where i see that um also if uh you have uh breakdowns that are uh more than probably you could actually look through that's usually when i'll see that as well uh do you have anything to add to that dan that's usually when i've seen that yeah i guess kind of kind of a follow-up question to that is are you talking about like um um vulnerability response are you talking about the vulnerability items because that's the one area that i'm aware of that you could see consistently in the you know in the tens of millions on a daily basis potentially yeah that's what he saw yes yes yes okay so where uh one of the nice things about that i can't remember when it started but i think it was exactly where it started what i would recommend is not changing the system property the overall s the pa system property to increase the maximum number of allowable but you can on the individual indicator source uh do an override of just that one of just that one particular indicator source to say that i want to allow that one indicator source so but the general yeah um so generally yes you do not there are you do not want to go for that large that many times they are that large of a data set for pa but there are some individual scenarios where you really don't have any choice vulnerability items generally is the one where it can but there are definitely some other things your other considerations do with that for example one thing i would do is make sure that you're not collecting that you're not collecting records so for example when you get to the actual on the indicator source you do the override but on the collect records um make sure on the indicator itself make sure you deselect the collect records option um so you know because that you know because that that can collect records collect the individual records can really slow down and can potentially even max out the memory on a node during the collection process uh so uh i mean so that so that's what you know it's it's not uncommon for a vulnerability job to take oh boy it could take an hour or two on for on a daily basis it's where they start to take like 10 hours or more uh you know on a daily collection that's where i would really start to get concerned um so i that that's so i i guess what i would say is you know just they're just that basic scenario and then also look for breakdowns and you know do you have uh where do you have a lot of breakdowns so do you have do you have more than just a you know three or four or five breakdowns for those indicators or try to minimize the number of breakdowns and even then within the breakdowns the combinations of breakdown so you have the option to look at the breakdown matrix exclusions are there places where you can do breakdown matrix exclusions so those are the couple of things to look at so there's not a there's not there's not a black and white answer but uh so what thomas and tara said from the for all other indicators absolutely is true for vulnerability of vulnerable items that is definitely uh the one the one area that that there is a big caveat to it that you'll definitely need to need to ramp up the number of records that you are allowed to collect okay great dan uh and there was another question that came in that is unrelated but um is there any out of the box pa content available for wsd i can't see any on the available analytics and reporting solutions page um dan terry have you seen any or heard about any yeah i have to i'm sorry i missed the question are there any out of the box constantly available for wsd what's wsd yeah that's that's yeah i have to claim ignorance on that to youtube [Laughter] you tell me what it is i can tell you yeah you what is wsdp here so that is uh workplace service delivery okay there you go servicenow product offering that we have workplace services they are hidden within other solutions within other solutions yeah you're gonna look there too okay um yeah i don't wanna answer that without checking so give me a second yeah pierre we'll we'll check on that shortly here our source to see if we can find something uh while she's checking this out let's see if we can answer ben's and and while you talked about this a little bit well he's just going to type you just go ahead and just um you can say it out loud it's fine so when we do have hr in our root map but um maybe um maybe an ear down the line right now uh right now we are uh working towards and we are working towards tokyo so for tokyo it's not yet in um in slot so that i can confirm but for utah and vancouver we'll let you know okay great funny thing tara yeah it looks like there's quite a few different things going on so i will just put a link in the chat okay that'll work awesome so and take it directly there yeah so if you want to talk about the useful resources that you have here we can kind of keep moving forward uh sure thomas so lastly uh whatever we have covered till now right so we have few useful resources out here which you can look at to understand more we dive into uh benchmark as a product you can the faqs that we have listed there are a few more that you can go through to see if those are the queries that you also have and uh just like we did a small demo today we also have a few short seven to ten minutes videos on youtube as well so i've provided the link to all of those resources here which you can use it at your disposal while you are trying out benchmark at your organization awesome thank you i'm gonna go ahead and take over here thank you very much great great information like i said i know that there's been uh there's quite a few questions that come into the community around benchmarks and being able to now have this source with what you presented and demoed but but also the questions i think the questions were really great today so i think that though the answers that we've gotten today will really help um other people out today so i appreciate customers asking those great questions along with the great presentation and demo that we had today so uh thank you for that and we appreciate you coming in and like i said earlier uh maybe a few months now who knows how long but i know that you and i were talking about doing some more in-depth type uh stuff in a demo so we'll we'll see if we can get that on the calendar as well for uh everyone but thank you for what you uh presented today and i think it was great so real quick as we close just always remember the uh platform analytics academy community page this recording will be out there on that event and it'll be out there within the day or within today uh before close business today for me it will will be out there so make sure you go there and of course it's always out on youtube um there we go uh and just you know our community page as a whole there's great information that's out there um the customers really make that as pow as powerful if not more as we do they aid in everything that's out there so really good stuff there so if you're just new to it anything within the platform analytics or reporting or whatnot uh definitely check this source out because it's going to give you great information and always there is great training inside of now learning it does have a new look which is awesome um but definitely go out there and just search for this example that you see or just search analytics and it's gonna bring back all the great training that is out there if you don't have an account you should uh please utilize it as much as you can here are some other great um academy sessions that are out there platform foundations mobile app academy and virtual agent uh check those out as you can those are ran really really well and great information is on that as well so take advantage of those uh always show this i know it gets redundant for some that are here all the time but i think it's important for you to know how to write a good question inside of the community so it will get answered and get answered fast with really great information so these are tips that you can look at as it relates to writing questions in the community so check that out the next time in two weeks we're going to talk about conversational analytics dashboards so this is actually going to be really new for me so i myself am looking forward to this so come back in two weeks on february 23rd and you'll get this information and um dan ortera i don't know if you have anything that you want to add here at the end but if not uh i appreciate everybody joining and of course for you presenting and demoing uh so dan terry got anything i'll share before we go nope just goodbye everyone thanks thanks for taking care of this thomas yep no problem all right we'll see everybody in two weeks thank you bye you