[Music] foreign [Music] hey hey how's it going it's going good how about you guys nice hi Kevin so nice finally we made it to our prior discussions yeah awesome we don't have her needs with us today he had some uh personal issues and he couldn't join us so we'll be just kicking him up with us three this and quite interesting topic to go through right so chat GPD it's been it's been around for quite a while and people are just going crazy yeah if you if I open LinkedIn right it it like there's this post everyone creating apis virtual agent portal and whatnot they're just doing every sort of stuff over there so yeah we'll just uh go with a quick round of introductions and then kick off so this we start to do sure I'm Jace I'm working on servicenow since forever ago but most recently I built a tool called scribe monster built using AI I bet that's why I'm here whatever way whoever is next hi everybody uh my name is Mark Scott I am a senior platform architect at now learning um yeah I've been I've been in the ecosystem less time than Jace has I think I think Jason's got me on a few years but um I have created a startup called Zen B which is doing social media and chat GPT um so that's why I'm here amazing so hello everyone myself is Sean uh I'm a senior technical consultant working with Toyota and I have just played around with the chat GPT for like a couple of requests like you know type me as a cleave email and all that but I haven't created any sort of stuff but we have got two you know great people over there topic we will be talking about what's what they have created and I am what I've seen is like it's great stuff so let's get into it so you know like what is like jar GPT like uh Mark and this like I I have read about it a bit and you know played around with it as well but just like what from what what's your point of view on that I mean chatgpt is a specific model that openai provides that people can ask questions to and it gives answers back it's I I they haven't I don't know that it's public how they've made it do what it does but you can make a lot of good guesses at what it's doing if you have messed with these large language models and I think I think that's the big thing like chat GPT is kind of like saying iPhone right like you know back in the day everyone said iPhone for smartphone right chat GPT is a open AIS you know it's their IP so when we say chat gbt what we really mean is it's a chat bot but it's it's a really well trained chatbot and that's that's kind of the difference is that this this chatbot has done you know far and above what a lot of the other ones have done and so that's what kind of got everybody's attention is this it's almost turning complete like you can almost like there's a little bit to it where you just kind of it doesn't quite get things right but it is almost a completely turned complete like um experience I mean it passed the bar yeah yeah right like I don't know I'm curious would it pass a certified system administrator tests you can it might I mean it might if you train it with enough data right it can I mean I'd be curious if it would pass it yeah yeah but I mean it'd have to be like an oral exam right you'd have to it'd have to be someone asking the questions it wouldn't you couldn't click the buttons yeah I mean we write code for a living we can have it click buttons uh yeah I think it won't be passing the Delta exams you know because it's until uh 2021 right now yeah yeah but there's ways to make it so it's smarter not chat GPT specifically but you can you can do stuff so it's more real time nice and yeah so you know how how does it sits within within the service now system like like again coming back to what I was just saying that you know I've been seeing people integrating with the virtual agent oh like it's got an API we can we can use it with a lot of ways that we want to but in the what's how can we fit in with the service now system you know and use chat GPT around the same any thoughts on that so I mean I think I think virtual agent is the it's the obvious choice right if you can like just take the nlus take all the training data out like you don't need any other it's just like just hook it to this um from a how how useful will that be I you know I don't know because what what's going to end up happening is it's going to learn things and it's going to kind of uh there's a there's a setting called temperature and the temperature of some of the like sometimes you have to like Let It Go and it gets kind of wild and then sometimes you're like I'm gonna reel it in and then it gets way too specific and and it it's there's I think there's a balance between where can it go into the platform like there's there's some I see some production capabilities and I see some other like um maybe maybe I wouldn't do that so when when someone says oh I'm gonna put it into the the virtual agent I'm like that's cool but you know it would be neat is if it was like classifying incidents or doing tier one support just you know just from like I need to help you know password reset I think I think it'd be cool like not just to see it in like the conversational side but to actually put like a business case to it yep yeah I mean servicenow did like years ago they made their own tax classification or right categorization I don't know what they call it I haven't dug into it back in the day they had required 10 000 records to train their cortex so it could assign stuff appropriately right um and that's as far as I got with it 10 000 records to me was like that's just way too much like categorizations change more often than my opinion than right when that happens and so I I never really looked into it but now I'm curious I want to see how that works well uh there's what's funny is there's all these tools now that are coming out in in the same realm of so if I don't know maybe not if you're not building some startup you're not trying to like expose chappy GPT to the public you might not know this but openai has a free a completely free moderation API where you can you can type text in and it will give you the the like how mean that was like it'll give you a ranking if it's negative or positive like that you know five even I mean let's just say even two years ago right you would be paying an API to do that you know this is this and they're just like this is just like a footnote where they're like oh yeah throw throw all the the prompts through here and make sure that it's not violating our you know moderation policies like it's just it's like this free open API anyone can use it so you know there's there's even more kind of application to this that then I think a lot of people are even realizing yeah and like open AI isn't the only one with these kinds of apis right like there's another company called uh cohere AI which will let you tokenize a string I think that's a free API from them I think I'm not sure I've been I've been looking at Alternatives open AI because I'm curious what other ones offer right and whoa and then yeah from from let me just from an integration standpoint if you're looking to integrate open AI is the way to go like it's it's the easiest one out there in my opinion like I haven't found a better API it's it's okay it's not exactly restful it's it's there's some you know limitations to it but um from a get up and go it's like API key you get 20 for free and then you go and do whatever you want to do yeah I mean AI 21 and cohere are very similar are they okay I'll have to check them out yeah I think I think going forward they they won't be free right like similar to like YouTube they got us addicted to YouTube music and stuff and it's now like a mandate paid expression that you have to give if you don't own ads so it's similar to I think that's that's the way the chat is going forward like right yeah well I could the there's been some instability in the apis from open API and from someone that's paying them to like keep the API up I'm like okay guys let's get this figured out because you know Microsoft just put 10 billion dollars into your your products so hopefully you know the apis will be a little bit more stable yeah I think Google Google is also coming up with something something on the same lines I read somewhere on the news a couple of days back so you don't have to use open AI though you can use Microsoft directly well and you don't even have to use a third party because Jace you and I were uh messing around with this stuff you had a server that you were running that was just in your house and you were run you were making calls back and forth right I was running stable diffusion that was yeah but oh it wasn't text completion okay so it's a little different tax completion is way more intensive there are some open source uh projects to do text completion locally but they're I found them very difficult to use I should revisit that topic though now that I'm way more versed in how this stuff works because I haven't looked into it since October nice I think we the answer is yes but uh do we have a limit how much data I think three times or three calls all of these restful AI sources cohere AI 21 openai they all restrict your um your message is in and your message is back to a token limit and I don't think this is a I don't think it's how that you're like planned to make it work but I think it's a limitation of how this large language model stuff works but a token is it's a part of a word or phrase and it's what the the large Legend model would guess would be the next best thing said after your question and so on the older models the token limit was like 2000 right 2000 tokens and they say a token is approximately three to four characters or a word but it's different depending on the language English the tokens are bigger than like Spanish for some reason right and it's just it's interesting the um the the other thing to think about is uh the API you know it it will hold open a connection so if you if you jam you know a whole 20 paragraphs down there it'll take it and then it'll sit there and classify on it and do whatever you tell it to do but it'll take a while right so a lot of times what will end up happening so this is this is the way like if you're if you're thinking about it from an architectural standpoint right um I did I I tried to go like a pub sub model where I would emit an event and then it would come back and then I would just read the response back when it was ready um and that's what that's what I found out like with open AI if you you can sh you can shove as much stuff as you want down there but then you're going to be sitting there waiting for it to classify and it's going to take a while and that's that can kind of be an issue when you're dealing with apis and especially with you know HTTP and you know the connections can time out that's you know just be be aware that classifications can take a while and your connection could potentially time out in an API if you if you're not you know limiting the amount of space you put in there it's interesting you bring up the pub sub model I haven't thought about that all of my calls are clearly straight there like if it dies it dies there's not much oh no yeah yeah I think it it might also depend on the third party system that we are you know doing the call with that it might not accept that long token that would be a restriction like I think service now also has one or you know on the amount of data coming in as a part of one request so you might have to take care of that as well so I I would imagine it's a Linux packing because I think they've got like a Docker swarm that they run in the back end there I don't know how their actual architecture works but yeah if if if it can't be handled in a Unix system it probably can't handle it yeah nice nice so this uh mark would you like to walk us through you know Skype monster and Genie so yeah do you want to go first Mark no you go ahead all right so scribe monster is my way of learning AI seriously I mean that's how I at best learn things is if I build something with it and so back in November when I found Chad gbt I was like this is really interesting who made this how does this work oh open AI made it oh they got apis let me see what these things are oh they have a playground oh this is kind of neat and I was like well I want to build something and so like many if you've been watching um LinkedIn people are like oh you can integrate servicenow and chat GPT but they're doing it like with a UI action or business role like but that's not going to be useful for most people let me throw in an extension I'm going to copy Arnold Coy's SN utils like way just make an extension and uh yeah let me let me pop it up and show you what it is so as it if you go to scribe monster you're having a out and pull up my screen um if you go to scrymonster.com I gotta find the button you can make an account quickly so this is I haven't yet okay oh there it is right land on a page like this you can click on get the extension extension from the Drum store which has 300 users so far which is wow right that's huge wow and then you can sign up with uh your name and email and a password I'm going password list this week it's gonna be an event I'm excited uh I love the placeholder text yeah that gets a comment every time um once you sign up um you'll be given an API key effectively the describe monster where I man or massage your prompts and I tell it to do stuff with it but let me let me show what it does in an instance here so I've already got try monster installed on my browser I don't know you can't see that I have to pop it out to show you so in my oh I can't even show it that way um one second here I have to change what I'm sharing oh in the pop in the pop-up that shares uh if you're on like a screen share like this and you're sharing a window it's a different context it doesn't share the pop-up from it so it is a pain so here is what the pop-up looks like when you click on it uh right it comes in here you put in your your username your API key this is going to change email here this week and then this domain is for me because when I'm running it locally I run the localhost uh and then it's got some other features up here which we can go into where you can ask your questions or have it summarize text or try to have it make some like documentation for you which is really cool because it does stuff like that but that that's all in the the address bar there it doesn't interface with the um with the instance the instance looks more like this just gotta get one more place nice so on the instance uh it doesn't add a whole lot of stuff but I've added it to a bunch of I'm just gonna go to my favorites I'm going to a client script but it adds it to a bunch of the OtterBox field or tables right so client scripts business rules script includes those kinds of things and what it does is it adds this button down here it used to be here but I just put it down here and when you click on this it opens up this this dialogue um and it's got a whole bunch of stuff in here I want to clean this up but right now this is what it is so you can give it a prompt to create some code it knows the context that you're on a client script it also knows that you're on whatever type of client script I didn't pick the client it did but it didn't take it I guess um in any case you can doubt the load in like the script field right and it'll pull in the script data and you can say oh tell me what this does explain this text and of course it's not going to work today that's fantastic that's what's happened right like whenever you know guests arrive at our home uh you know the there's no electricity I've been I've been constantly messing with this so I'm guessing that uh that I just I screwed something up in my last push maybe you know or and I've gotta I've got a renewed respect for a nude because like pushing this to the like the Chrome Store it takes sometimes Google's like I've got it done in like six hours and then sometimes it'll hold it in there for like three days and like you never know and you're like oh man I hope I didn't screw that code up because it'll take two days to get into everybody's browser oh man it's it's it's yeah nerve-wracking yeah I screwed something up with my most recent push so I guess it's a big fail for me on this side but if you want to see it if you go to the Chrome Store there's a video of it I'll have it fixed I'm sure by tonight or tomorrow but it normally it would explain to explain the code for you or edit the code that where you are creating wow yeah but that's okay um such is life when you're learning stuff I'm learning all sorts of things Chrome extension development and these AI things and chaining requests and it is is quite amazing oh there is one thing though that definitely does work because I checked it up before do you want to see a feature that's coming but not there yet ooh sneak peek yeah all right this is the only place it's gonna be showing so far because of course I went away from the window and right now it's locked down to people with admin role in my system so if you if I go to scribemonsters.ask it's like a chat bot interface right and I've put in some things so it knows how to answer your questions about servicenow so uh do you have any question you'd like to ask it um uh when when is the knowledge 23 happening where is the world where is now oh oh this oh for some reason this happens when I'm streaming so knowledge 2023 happening yeah is it gonna do it I don't know you know this is it I I can tell you what it's what it's doing in the background it rephrases the question and it does a query based on the things that I have and then oh this is totally failing it was literally working I don't know what I did I screwed something up started streaming I started streaming well this is running out on the world so I broke it's all broken don't look at my stuff today come back tomorrow check it out oh that's okay though I feel for you buddy it happens with everybody today so you know even incline demos sometimes oh man the last time I had a flop like this I was trying to demo the twilio integration with serviced now back in like 2015. that was a hell of an integration dude like that one was that one was uh yeah I did that one too so uh anyways do you have anything done sure yeah I'd love to show you guys so um let me share my screen all right so um I uh I I I took a I took a little uh marketing advice so this is zembi zembi's uh my extension but also website very similar to what Jace is doing um and I'm billing my website as the easiest way to try chat gbt um this is our little demo page in our Lander that you can try uh and what it does is uh you can it's up to five words in here I didn't want to do too much so what do we do um praying and summer there we go all right so we're gonna hit go on our way please hold I've got my humor peppered throughout this entire website so um so here we go um nothing beats a scoop of cold ice cream or cold and creamy ice cream to cool down during the summer days you can hit tweet you can copy to the clip board but that's really kind of the demo so that's that's what's out there in the world today you can go and hit zembi.co try and you can try this yourself and you can actually uh copy this and send a tweet or do whatever you want to do now what am I going to go for launch so for launch what we're actually doing is um the extension is built into uh Chrome and within Chrome we're going to inject a couple of buttons and a couple of cool things that I'll show off here uh but my my favorite here is the repost button so I'll hit repost um it pops up and it says you know give us a sec and it's going to fill this out um congratulations on your new role as itam practice director for Cask so you could hit pay you could hit post and use that if you want but I also inject this little zembi button down here so maybe this isn't exactly what you wanted so you click the button again see what happens so congrats to my friend you'd have to put the name in on the role all this stuff is ready to go you click the button and it's just here that one's kind of fun I'm going to discard this but the other thing that's really neat is I inject another button in here when you hit the comment button I can click and hit comment so if I've been commenting like a madman on you guys stuff you know what I'm doing I'm actually testing um I'm going to hit post on this one because that one's pretty good there we go so there's comments there's posts I know uh remix so uh let's say that I really really really enjoy uh Chuck's post here about remarkable so I'm gonna hit remix and what that's going to allow me to do is I can do do come on there we go um it will take Chuck's post it will copy it it will rewrite it and then I am ready to post it as if it was my own um it You Know Remix so there's that nice I'm gonna I'm gonna discard that I've got one last thing to do so um if I go to these MB blog so yo we'll go to our blog and let's say that I picked the very first blog post that we have here for about SEO um the last place that this is integrated is if I right click I have a little zenby button here I can hit create tweet or create like din post we've been doing LinkedIn so let's try tweet and it'll give me just a second all right and a new tweet will pop up Auto magically ready to go all right there it is it actually shared the uh the link there um so uh because this is my my blog I don't shorten the URL uh but if it was to be anybody else's so any you know I just pick a random let's just say YouTube video uh it shortens the URL for you um what that does for my users is then I can go into um sorry my wrong one I hope it's running uh so this is the profile uh but this actually allows you to um I'm I'm tracking I don't know localhost isn't working that's right um I'm tracking the clicks so you can actually go through you can see the analytics um I have a nice little graph and all of that so let's do this one give it a second so you can see all the analytics you can see the total clicks I've got breakdown by country by city by browser by operating system so this would be if I shared this out and then everybody you know clicked on this this is something that I shared on Twitter and then these are all the clicks that I aggregated through that um yeah and then you know just basic stuff like managing your profile and yada yada yada so you can see your usage and when your license expires and Etc et cetera and then I have a history of all of your um all of your scent like if you click the button so you can see this is where we clicked it and then you can see here's Chuck's Post in here so yeah that's that's everything I've been been working on it's yeah it's it's great it's great so please like I should be also trying something but let's see if I can no come on that's this is all like kind of you know labor of love stuff it's just it's I'm I'm teaching myself a new stack that's that's been my big thing so yeah I'm curious about that stack also really okay I mean yeah Sean do you want to get into it yeah sure why not yeah why not um so I wrote it all in node.js um I've got Express for the web I've got uh fast fast five for the back and is my DB I then there's a couple I've got the cloudflare with some caching and yada yada um cloudflare workers are actually running on like my image resizing services that like with the blog posts and stuff I don't have to mess with like photoshopping a bunch of crap um and then uh I'm trying to think what else oh uh the actual work is done from the Chrome extension through a service called ably it's a real-time messaging protocol um and it that's what I was talking about Pub sub right so what happens is um you click the button and then that little pop-up hits and then I do a websocket request that's abley's socket um out to ably and then abele talks to my background worker which is also written in node.js but which is behind my firewall and nobody can actually access it does the work and then it emits an event back because your client is listening for the event and then that's what closes the browser the closes the little thing and then pops your posts in um but yeah it's it there's a lot of node.js there's a lot it's uh oh and it's all hosted on render and then I've got a CI CD pipeline all through um GitHub actions and a Cypress test that's testing both front end back end and my extension one day yeah sorry yeah one of us here is a professional the other one definitely you guys are all you're like um I used to build full stack applications for like cons like that's what I did before I did servicenow work so everyone's like oh yeah like no I keep an eye on this stuff and I go and build little things and then when I need to build something awesome I have all this knowledge and it just flows around yeah so I figured out why my stuff was broken oh man while you're on stream that's awesome yeah I wasn't like really authentication remember I said I was changing my authentication up oh yeah preventively I changed my username because that's what's going to happen I didn't change it on my browser extension no and I had lucked out while I was sharing my screen yep that's why the other thing didn't work would you guys can I redeem myself and show you that new feature yep I I'm very excited about this teacher I don't know if it's going to stay this way when I put it out there for everybody to use because right now it's like I said it's locked down but you had asked if it knew when knowledge or where knowledge 2023 is going to be and so I after I logged in I asked it again I think you meant where because it rephrases your question right but it doesn't so it doesn't know that it's been announced because I didn't I don't have any data in it about that but we can ask it where the past ones were thank you right wait I'm like can you do can you do oh sorry what's that no you should do uh can you do it like formatted as a list will it come out as like a ordered list uh it doesn't no say I don't think it has a lot of information but little itches okay let's think of another service now like topic yeah I have typed in all of my blog content there's a few videos there's information in there too app engine Studio something sure it's too recent though maybe I don't know did you have you trained it with apple oh because all of your content got it I loaded all of my blog stuff into it so it's using that and it's doing some other stuff with it it's kind of interesting like uh you might want the one I go to because I know it works well is ask them applied record Collide query and glide work and secure right I'm glad it could get right um what is like you could ask you just like what is the difference right uh what about uh when when should I use a script include oh sure when should I use a script it's still a work in progress which is why I like I have the thread the thread right right I think it ditched I am some you know many times like quite a bit like even for a small result to return a script my project that's not what I meant still you're not supposed to rephrase it that way well I mean it's not bad all right we have one from Kevin Lester different script types different types of scripts different types of scripts in service now difference we'll see if it uh see what it does yeah it's really interesting I got into how like you can search content with AI using Vector searches with this which is crazy I feel like I just got a new superpower because well and so let's let's talk about that for a second while this is loading I think I think what a lot of people like what's you know what's the future of chat GPT or what you know what are we looking at from like the future holy cow subscription uh to see this it's got some stuff that's wrong here I'm still whatever it's not bad you know it's um it's pretty much there like so oh you can't write Java right and stuff and you can't write PHP in here right um so I think the the the thing Jace that like like even with this it's not it's it's not about what you're putting in and that's what that's what a lot of people I think get confused about it's not about the input it's about the prompt right like you've got to massage that prompt just just enough and that's where I'm like yeah I'll show you guys all the stuff that I built because like my IP my actual intellectual property is the templates right it's the little it's the prompt templates and how do you how do you get it to work just right in all these situations ah I love that yay you know what I'm not going to do another question here because it's obviously it's not quite working the reason it gave me the wrong answer though is look what re wrote the question yeah it rewrote it like this and that might be because I didn't end it with a question mark yeah right if I did it like this and I just did this you'd see if it answers it differently well that's loading a vector searches this imagine if you could take any bit of text and assign it a set of numbers and those numbers you could then use to infer the meaning of that text like I could say ice cream is cold then say ishan asked a question to this AI system and said hey what is some cold foods that I can eat right it wouldn't it could infer that he's asking for foods that are cold just like the other thing he was asking about cold foods right or saying that that ice cream is cold food so what you do is you take those arrays of numbers and you multiply them together and you get a uh a number between zero and one on how close it is to having the same meaning and then you sort if you have a bunch of stuff in a database you would have all those embeddings they call them save somewhere and then you sort them like uh highest to lowest and that gives you the closest response the closest like set of data to your question so that's a vector search it's I guess I thought it was a like did you guys ever take linear algebra would you recall it like oh my gosh like I'm having flashbacks right now where he's like then you multiply them together and I'm like it's not that simple oh my God you can't multiply two arrays together that easy it's you gotta do a whole bunch of weird stuff yeah I mean so it when my when I read it I was also confused it took me like a day or two to figure it out but then I figured out I saw the numbers and I was my mind was blown I think I got a C in that class that's just because service now offers AI search I'm investing they save their embeddings somewhere but it's not in the platform that I can see I had to troubleshoot it recently at work yeah there's there's taxonomies and a couple other things that it bases it off of I know that for sure but from a you know how does it exactly work I don't know we black boxed it in in now learning and said that's a third party system like and that's how we called into it is we've got a third party that like database of all the search stuff so yeah I haven't done so much with search in AI search it's it's interesting I'm curious because I don't know if it's doing it but like the entitlement stock says you get 500 000 documents indexed with that entitlement um if you want more you can pay for more but I don't know if like they're indexing the whole thing or individual statements or both you know what I mean like because it's it's interesting you know what openai came out with an a with an API and I went oh that's much easier than learning I don't want to be a data scientist I just want to like call into this API and that's yeah that's what's really cool about this stuff yeah so I piped in a bunch of stuff about servicenow obviously it's not exactly right here Jace how do you pipe stuff into this like how do you train it is there like a special format no okay all right so there's there's two types of things when you look at like how do I make uh AI answer questions the way I want to answer questions right one line of thought is using fine tuning but that is the wrong thought from what I've read I mean I'm not an expert in this I'm still learning I could be wrong here so if somebody correct me if I'm wrong but fine tuning is where you say here is a question and here is the perfect completion for that question and here's 49 other ones like here's at least 50 of them and that's great if you want to train it how to do something like how to teach it to do a task like maybe you want it to always respond with the temperature or like maybe you want I always respond with one of five categories right but you don't want to have to have a prompt to say right these are the categories right right that'd be a great use case for like a fine tune got it um what I'm doing here is I have a bunch of content in the database and I just query it with the vector search right and I say give me the top five summarize them into smaller chunks make that my context and now answer my question based on that context wow oh the toy like it's you know it's going a bit here and there I think right yeah but you guys all nerded out because I was like like I said a bunch of technology stuff like he's Jace is training his own like AI bot over here to take over the world like that's very cool like a Roblox if you start thinking about how you think it's really interesting like if you say a phrase and it triggers a memory like just think about that for a minute somebody said something it's like one or three words and it triggered something that you're like oh I remember the time that I fell off the Grand Canyon or I don't know whatever foreign would say something like I don't know ice cream is cold and I would think of the time that I used to work at Dairy Queen and uh somebody complained that their uh whatever their Banana Split didn't like it melted because it was too hot right outside because it was summer and like is there any Rhyme or Reason Why that memory is the first one that came to mind that I just told you guys no no but when you think about it like your brain is actively like thinking about other things other memories and like it's trying to figure out what you're looking for and maybe it's coming back with a summary of those memories maybe it's coming back with a list I don't know I'm not a cognitive person like that but this stuff has really gotten me thinking about like how the human brain really works I didn't I didn't need any more like hmm like I do process optimization in my head all the time where I'm like okay how do I go like to the grocery store that the gas station like I yeah like I need I don't I don't need any more like how do I think yeah that's but if you're thinking about how you think you can start emulating that on a system hard to do that that's called object-oriented programming I've already done that one so I'm not doing that again I've heard this I've heard this again like once before no just kidding but yeah I'm really excited for this feature that I haven't released yet um and I'm still working out the bugs obviously I have to fine tune my prompts because obvi this is a couple prompts mixed together and it's kind of why it takes a little while because there's a prompt to like rephrase your question and there's a thing that like summarize the stuff based on the prompt so that it gets the pertinent details and then there's a prompt to actually answer the question all right so I don't know I think I think he shots too too polite to ask this question but how how much do you spend like because I I've gotten there's a number in my head of like the when I make a completion and I do I do a full completion with tokenization all that stuff like there's a number in my head regular that probably cost you know this much and I'm interested in like because I'm my theory is that because my tokenization is so small my bill is like teeny tiny like I like everything is like fractions of a sense so I'm I'm wondering like what's you know are you are you eating into your bill a lot or is it just it's especially with two you know two classifications there um it's actually not that bad because I'm not using the better models for some of that got it actually the only one I'm using the the so there's the models you have access to when you're using the apis with open AI is text DaVinci uh text hearing text Babbage Text data and they do they have different things that they're better at and text DaVinci is the closest to chat gbts right which is based on some instruct model it also costs the most it's two cents per thousand tokens which they change your pricing page a few times the last couple weeks I don't know if you noticed that it went up to three cents per thousand more and then them two and I don't know it's it's interesting the API also went up and down too that might have something to do with it like yeah it might uh but I'm using the text Carry model for a lot of that summarization got it um and so when it's summarizing these blocks of text of a thousand to four thousand characters it's not a whole lot of money because the text Carry model doesn't cost two cents per thousand tokens it costs point zero zero yeah and and that's that's kind of the like all I when I run my tests so I run an automated test Suite that like I don't I'm not gonna go put the good stuff in there right like so I I downgrade it just like what you're talking about like I go down to like Babbage or Ada or something and then I'm like yeah go I don't care as long as I'm getting responses back it doesn't matter if it's good you know and then and then when I go live like I I bet you know it's back up to uh davinci03 so yeah that's interesting it's not for the use that I'm getting out of it right now it's less than a dollar a day right yeah yeah I I've got I've got a telegram message every day of how much how much money it costs me and it's like I don't think I've ever gone over two dollars uh actually though I take I take that back so the the front page of zenbeat like if you load it there's a little like blurb that says you know we do this and blah blah that's all that's from chat GPT as well like that I've integrated it into little parts of the website um one day I accidentally forgot turned off the in-memory caching because I was doing something good Dev and and I forgot and I like and it went and then what I had is I had a um I had one of those like HTTP pingers to make sure things stayed up and it hit it like once every like five minutes like for like all night and so my bill was like five bucks for that day [Music] and it was like well at least I know it won't ever like go crazy because that's about as crazy as it's gonna get yeah so yeah I think my my opening eye bill is less than 15 bucks the last two months it took it took me two or three months to chew through the free twenty dollars that they give you oh I went through that the first month oh well but then I was messing with fine-tuning not understanding happening yeah another thing so yeah yeah if you you know if if you're looking to try it out like uh open AI gives you twenty dollars for free um which is really neat because if you're just doing little tiny things it you know it's not gonna it's not gonna add up it takes a while to chew through that so yeah yeah but there's a lot in here so do you have any questions DeShawn I do have a lot of questions [Laughter] but yeah but you know I'll take it offline with you guys no come on we've got like we don't have time like let's let's do it let's hear it I want to know like you know just maybe someday all right maybe someday sometimes something similar so you know I do some amazing stuff that you and yes been doing so yes okay now like we were just talking post pre previous session so about js's website so he has integrated AI there as well so you know yeah if you're curious do you wanna okay what have I throw it on the screen so you know he's just I'm just so excited to share you know it's also about you know uh time and money is one thing but you know coming up with these uh ideas is another uh thing that I think is a one not everyone can come up with so you're coming up with unique things and I'm planning on monetizing yeah I want to get to the point where it pays for itself yeah exactly so if you're not familiar with news.js.pro that's what this is Shameless plug and also like if you have content that you write about or that you create that you would like in here please just shoot me a message um and I'll add it to the list so that it gets I'll add your feed I prefer RSS feeds to the list digital get aggregated into it but this content below these posts is really neat because I didn't write this and and neither did the author opening I wrote it so when it ingests this data I say hey does this thing have content that I can summarize if so do so and then update my database with that summarization it's so funny that you've gone to the like you and I have gone to the same place independently like it is so good at taking like a link the um downloading the metadata from like a website or a blog post or even like a YouTube article and coming up with like a little summary it is so good at that I it's scary what's also crazy is I've done it with YouTube videos yeah YouTube videos are really good especially if it's got a timeline oh it does so well well yeah so yeah so I'm using the transcription to build okay right so like if you're not familiar with Justin Meadows he's been doing a whole bunch of AI stuff as well but in here it just tells you like what he does and it's this is not to take away views from anybody this is just so it's more convenient to know what you're getting into because if you're like me you're terrible writing titles like training paths what does that mean I have no idea but let me read what this thing thought it meant who is Brenda and this is so accurate right right oh yeah yeah uh I don't know she's somebody on service now it's a certain extent article oh okay okay right but developer implementer it's just it's very interesting because like I also like I didn't tell it to translate in English yeah yeah it does crazy things I didn't tell them to summarize in English I just told it to summarize it summarize yeah and it made like yeah they say it doesn't speak Japanese I'm like I every time I've tried Japanese it worked just fine like like English Spanish and French I'm like Japanese sounds pretty good too but I don't know I don't speak Japanese so it might be terrible it's kind of interesting these videos that don't have a transcription or don't have a thing it turns out they don't have a transcription right so I I don't do anything to read that yeah nice very cool awesome all right though yeah you still have some time but don't have any questions in chat was there any I didn't see anything I was like I was monitoring yeah I don't think we have any we do have eight or nine viewers which is I think good enough so yeah yeah that's good man this was fun yeah I love talking about this stuff yeah I could go for a while it's just been nuts me and Mark we talk privately and other things and we still haven't this is the most I think we've talked about it well and that's like someone's gonna be like well you know why why is Jace and Mark all hot like why is everyone hot on Chrome extensions It's like because Jason Mark talk to each other like oh I can do that with this thing oh yeah have you tried it with a Chrome extension it's like no oh okay I'll go try that right like it's that's that's how we all kind of end up like you know we we don't build anything in silos that's why things start to kind of look look similar yeah yeah I think it's it's just going crazy right even for me like I haven't built a Chrome extension yet like maybe someday like don't stand it's worse than one thing it's worse than app development it's oh bad Kevin is saying something about Firefox I would love to make my extension work in Firefox but I'm using crxjs to make my extension and they don't support Firefox yet they're waiting for manifest V3 to be totally implemented in Firefox which was just announced like last week oh see I've got so I've got a I've got a a cross browser transpiler I'll try but I don't know we'll see like it's supposedly supposedly I should be just be able to hit build Firefox and it should all work but we'll see so yours does it build in manifest version three or two uh right now it's three because I'm using the Chrome because it's Chrome and I don't really care um and that it was like do V3 and I'm like all right whatever but we'll see I don't know I haven't learned anything about the Firefox extension I think the first thing I'm going to learn is how to downgrade to V2 for manifest so I don't know if I I I have monitoring on my blog and stuff like the quantity of people that are using Firefox versus Chrome I just don't think it's worth it yet to do it because it's like eight percent or six percent really okay yeah well I I'd be that's you know I'm I'm gonna monetize first monetize first like yeah gotta get paid Kali is asking me are you building something not not yet he's he's running the streams just like you Kelly yeah so uh I'm also uh you know on in the process of writing a book so hopefully yeah hopefully it goes through perfect service now Services yeah I already noticed that in your background yeah yeah your boom Army I think is in the way of the Top Shot I'm sorry oh there you go yeah that's nice is that three books or four that's only three books yeah it's nice it's two it's two oh you got tens and gorans and what's that Tim's and Gordons and then that's at both it all right I thought that was another book on the next show no that's what was it I had to nerd out a little bit but yeah it's just about that yeah also very cool all right I think if we don't have any questions we can probably you know how do we end it I'm just you know we got to do are we gonna do are we gonna do our sign offs are we gonna yeah sure can you find us yeah you can so I'll do uh like you can find me Phoenix Dev at anything right here um Phoenix dev.me at Phoenix Dev on all my socials um LinkedIn especially you know connect uh yeah let me know because this is uh LinkedIn LinkedIn yeah LinkedIn yeah yeah you you're good about like retweeting me on Twitter and all that stuff but like LinkedIn like man there's something about LinkedIn like everybody like LinkedIn is where everybody's at so yeah LinkedIn I think if you are you know creating something or the LinkedIn has got the most traction on my things so yeah great well jstep Pro right that's where almost my stuff is but uh I am also on LinkedIn this week on Wednesday on Thursday uh me and Cali are doing an event so feel free to come on there at 6 30 p.m on Thursday 6 30 PM Central uh on Thursday I'm excited for that yeah nice and check out my extensions grab that monster it happens it works when you log in yeah yeah and also js's web News website uh Pro so and yeah you myself you can find me on the LinkedIn YouTube it's my full name uh that's coming up on the screen that uh and every platform that's my username as well convenient yeah all right thank you Mark thank you Jace thank you for joining thank you thanks for putting this together yeah thank you have a good one same to you bye have a good night bye